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Section  t.  OTectriew 

In  this  paper,  we  develop  a  method  for  assessment  of 

utility  functions  for  multiple  criteria.  Suppose  that  there 
is  a  multidimensional  outcome  variable,  which  we  shall  call 
0,  and  a  set  of  acts  on  which  the  outcome  variable  ^ 
depends.  In  the  decision-making  procedure,  we  shall  want  to 
choose  among  the  acts  when  the  value  of  e  is  uncertain.  In 
the  Bayesian  approach  to  decision  making,  the  problem  has 
two  components:  a  probability  function  over  the  variable  ^ 
for  each  possible  act,  in  this  case  a  multivariate 
distribution;  and  a  utility  function  over  o  for  each  person. 
The  Bayes  rule  is  to  select  the  act  with  the  highest  expec¬ 
ted  utility  with  respect  to  the  probability  function. 

The  form  of  the  probability  function  has  been 
extensively  discussed  in  the  literature  and  does  not  receive 
primary  attention  in  this  paper.  It  is,  however,  relevant 
to  some  degree  in  that,  because  of  considerations  of  sim¬ 
plicity  in  the  computation  of  expected  utilities,  the  form 


of  the  probability  distribution  may  constrain  the  form  of 
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the  derived  utility  function  to  the  class  of  conjugate 
distributions  (Movick  and  Lindley,  1978)  -  It  has  also  been 
shown  (Novick,  1980)  that  in  the  multiattribute  situation, 
the  relationship  between  the  joint  utility  and  the  narginal 
utilities  depends  on  the  (conditional)  probability  function. 

Thus  the  family  of  conjugate  distributions  is  convenient 
here  as  well.  With  adequate  computer-assisted  numerical 
analysis  techniques,  however,  nonconjugate  functional  forms 
can  easily  be  used. 

The  form  of  the  utility  function  also  has  received  much 
attention  in  the  literature.  The  primary  references  are 
provided  as  they  are  relevant  in  the  presentation  of  the 
background  material  in  succeeding  sections  of  this  chapter 
and  in  succeeding  chapters. 

The  emphasis  in  this  paper  is  on  the  form  of  the  3 

utility  function.  While  there  has  been  much  research 
concerning  the  form  of  such  a  function,  the  results  have 
been  insufficiently  general  for  many  applications.  Huch  of 
the  discussion  has  been  limited  to  a  unidimensional 
attribute  (e.g.,  Friedman  and  Savage,  19h8;  Hosteller  and 
Nogee,  1951;  Pratt,  Raiffa,  and  Schlaiffer,  1965;  Keeney  and 
Raiffa,  1976;  Novick  and  Lindley,  1979).  Many  of  the 

applications  of  decision  theory,  particularly  in  education, 
however,  involve  paradigms  in  which  the  variable  of  interest 
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is  Bultidimensional . 

The  literature  that  is  concerned  with  multiattributed 
decision  problens  is  also  United  to  some  degree  (Green  and 
Hind,  1973;  Keeney  and  Kaiffa,  1976).  Host  of  the  research 
has  assumed  special  forms  of  the  utility  function  such  as  an 
additive  or  a  multiplicative  function  of  the  components,  or 
other  nearly  as  restrictive  assumptions.  While  these  forms 
may  be  appropriate  and  useful  under  certain  conditions  (and 
these  conditions  have  been  well  specified) ,  there  are  many 
situations  in  which  the  necessary  conditions  fail. 
Additional  research  (Fishburn,  1973b)  has  provided  an  alter¬ 
native  formulation  of  the  multiplicative  utility  function, 
involving  sums  and  products  of  the  marginal  functions,  yet 
still  imposes  conditions  that  place  undesirable  constraints 
on  the  form  of  the  utility  function.  For  example,  in  Fish- 
burn's  formulation,  conditional  utility  functions  (those 
holding  the  levels  of  all  but  one  factor  fixed)  are  strictly 
linear. 

This  paper  proposes  a  procedure  for  the  assessment  of  a 
multiattribute  utility  function  with  a  less  restrictive 
functional  form.  The  proposed  procedure  has  three  phases: 
the  elicitation  phase,  in  which  data  are  collected;  the 
coherence  phase,  in  which  the  data  and  intermediate  model 
estimates  of  utility  are  checked  for  consistency;  and  the 
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nodelling  phase,  in  which  the  parameters  of  the  prop 
model  for  the  utilities  are  estimated. 
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Section  2.  The  Elicitation  Phase 

Utilities  cannot,  in  general,  be  assessed  directly 
perceive  them  only  through  their  impact  on  decisi 
Behavioral  data,  from  which  the  utilities  may  be  infer 
must  be  collected.  In  any  procedure  to  determine  utilit 
one  can  distinguish  between  a  data  collection  phase  and 
estimation  phase.  It  is  this  collection  of  data  tha 
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shall  call  the  elicitation  phase.  Although  the  choice  of 
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estimation  proccjure  is  not  independent  of  the  choice  of  the 
elicitation  procedure,  in  that  the  method  of  estimation 
depends  on  the  type  of  data  thar  is  collected,  and  although 
the  two  phases  may  be  interleaved  in  an  iterative  fashion, 
the  two  procedures  may  be  construed  as  distinct  phases  of 
the  overall  procedure. 

Much  of  the  research  an  the  determination  of  utilities 
does  not  make  the  distinction  between  the  elicitation  and 
estimation  phases  clearly.  In  fact,  seme  of  the  advocated 
procedures  are  simply  called  "utility  assessment 
procedures,"  combining  the  data  collection  phase  and  the 
parameter  estimation  phase  as  one  topic  (e.g.,  Novick  and 
Lindley,  1979;  Humphreys  and  Wisuhda,  1979).  In  a 
unidimensional  utility  assessment  procedure,  this  blurring 
of  the  component  phases  is  not  very  serious,  because  of  the 
simplicity  of  the  procedure.  In  a  multidimensional  utility 
assessment  procedure,  however,  this  blurring  causes  concep¬ 
tual  difficulties  because  of  the  greater  complexity  of  the 
multidimensional  procedure.  In  addition,  the  modularization 
adds  flexibility  in  the  construction  cf  an  appropriate 
procedure  for  a  given  application. 

Even  in  the  unidimensional  case  one  may  distinguish 
among  elicitation  techniques,  each  of  which  is  appropriate 
for  a  given  estimation  technique,  and  among  estimation  tech- 
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nigues,  each  of  which  is  applicable  to  the  same  type  of  data 
and  elicitation  technique.  The  various  utility  assessment 
procedures  of  Novick,  et  alia  (Hovick  and  Lindley,  1979; 
Novick,  Chuang,  and  DeKeyrel,  1979;  Novick,  Hamer,  Libby, 
Chen,  and  Woodworth,  1980;  Novick,  Turner,  and  Novick, 
1981) ,  the  Standard  Least  Squares  procedure,  the  Regional 
Coherence  procedure,  and  the  Local  Coherence  procedure, 
indicate  this  flexibility. 

This  paper  does  not  investigate  the  various  elicitation 
techniques.  The  purpose  of  this  paper  is  to  assume  the 
elicitation  techniques  as  developed  by  Mcvick,  et  alia,  for 
the  unidimensional  case  and  extend  it  to  a  multidimensional 
setting. 

In  Chapter  II  of  this  paper,  the  Novick  and  Lindley 
procedure  is  discussed  in  detail.  The  chapter  begins  with  a 
brief  background  discussion  of  the  von  Neumann  and  Mor- 
genstern  axiomatization  of  utility  (von  Neumann  and  Hor- 
genstern,  1947)  and  the  notion  of  expected  utility  (Savage, 
1954) .  The  assessment  procedure  of  Novick  and  Lindley  is 
based  on  these  two  concepts. 

Following  this  introduction  is  a  general  discussion  of 
the  procedure,  called  the  fixed-state  utility  assessment. 
Briefly,  the  procedure  is  based  on  the  concept  of  greatest 
expected  utility,  that  individuals  choose  an  act  or  outcome. 
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among  several,  having  the  highest  expected  utility.  Thus, 
to  determine  utilities  for  a  variable  o  an  individual  is 
presented  with  a  choice  between  one  outcome,  say  h ^ ,  for 
sure  and  a  gamble  involving  two  other  outcomes,  say  and 
0,  .  The  outcomes  are  selected  such  that  0  is  not  preferred 
to  0  .  which  is  not  preferred  to  6,  . 

It  can  be  shown  that  there  exists  a  probability  p  such 
that  the  individual  will  have  no  preference  for  either  the 
for-sure  outcome  or  the  gamble  over  the  other.  This 
probability  is  called  the  "indifference  probability,"  since 
the  individual  is  indifferent  between  the  two  choices. 

Following  this  is  a  general  discussion  contrasting  the 
fixed-state  utility  assessment  procedure  to  an  alternative 
procedure,  called  fixed-probability  utility  assessment.  In 
one  paradigm  of  this  procedure,  the  individual  is  presented 
with  a  choice  between  a  for-sure  outcome  and  a  gamble 
involving  two  other  outcomes.  The  probability  of  the  gamble 
is  fixed,  however,  as  are  the  two  outcomes  involved  in  the 
gamble,  and  the  individual  is  asked  to  specify  the  outcome 
of  the  for-sure  alternative.  This  is  then  called  the 
"certainty  equivalent,"  since  it  is  a  certain  outcome  that 
has  the  same  expected  utility  as  the  gamble.  A  review  of 
the  literature  that  criticizes  both  these  procedures  is  also 
presented. 
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Following  these  discussions  is  a  detailed  presentation 
of  the  least-squares  estination  procedure  advocated  by 
Novick  and  Lindley  and  iapleaented  in  the  Computer-Assisted 
Data  Analysis  (CADA)  Monitor  (Isaacs  and  Hovick,  1978; 
Novick,  Hamer,  Libby,  Chen,  and  Woodworth,  1980) . 
Criticisms  of  the  1978  implementation  by  this  author  are 
presented,  which  led  to  the  enhanced,  1980  implementation. 
Additional  enhancements  are  suggested  in  this  chapter  as 
well. 


Section  3.  The  Coherence  Phase 

Just  as  the  procedure  to  assess  utilities  may  be  decom¬ 
posed  into  an  elicitation  phase  and  an  estimation  phase,  so 
nay  the  estimation  phase  be  decomposed  into  a  coherence 
phase  and  a  modelling  phase.  In  the  coherence  phase,  the 
data  and  the  intermediate  estimates  of  the  utilities  from 
the  modelling  phase  are  checked  for  consistency.  The 
responses  from  the  user  nay  appear  to  be  reasonable  at  face 
value,  but  they  may  imply  relationships  among  the  attributes 
that  are  unacceptable.  There  are  two  concepts  of  coherence 
that  are  explored  in  this  paper.  One  is  from  the  work  of 
Novick  and  Lindley  and  is  discussed  in  Chapter  II.  The 
other  is  related  to  the  field  of  scaling.  Both  concepts  of 


coherence  depend  upon  the  assutaptions  that  the  decision 
maker  is  willing  to  accept  about  the  data. 

The  Novick-Lindley  concept  of  coherence  (Novick  and 
Lindley,  1979;  Novick,  Chuang,  and  DeKeyrel,  1979;  Novick, 
Turner,  and  Novick,  1981)  involves  judgments  by  the  decision 
maker.  Implications  of  the  data  and  the  selected  models  are 
presented  and  the  decision  maker  must  judge  whether  the 
implications  are  acceptable.  If  they  ate  not,  additional 
information  must  be  elicited  to  resolve  the  incoherence.  In 
the  paradigm  of  a  single  decision  maker  used  by  Novick  and 
Lindley,  the  decicion  maker  is  asked  to  reconsider  some  of 
the  original  judgments  (i.e.,  the  data).  Alternatively, 
gathering  more  data  may  be  more  practical,  particularly  in  a 
problem  involving  many  sources  of  the  data.  This  latter 
approach  is  often  taken  in  classical  statistics,  for  exam¬ 
ple,  in  discriminant  function  analysis  with  cross-validation 
studies. 

In  scaling,  one  is  concerned  about  coherent  judgment  as 
well.  It  is  assumed  that  the  scale  of  measurement  as  obser¬ 
ved  may  not  be  the  scale  of  measurement  with  which  decisions 
should  be  made.  For  example,  in  our  decision,  we  might  like 
to  assume  that  equal  intervals  have  equal  meaning  everywhere 
along  the  scale.  We  might  be  unwilling  to  make  this  assump¬ 
tion  about  our  elicited  data.  Therefore,  the  elicited  data 
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are  transforaed  so  that  they  aay  be 
operations  of  arithaetic  in  the  aodel 
of  aeasureaent  of  the  elicited  data  aa 
to  allOH  the  usual  operations  of  arith 
ful.  The  theory  of  aeasureaent  has  de 
noainal,  ordinal,  interval,  and  r 
Cooabs,  1950;  Coombs,  1951;  Siegel,  19 

If  the  data  collected  fora  a 
aeasureaent,  i.e.,  fora  a  classifica 
of  teo  data  values  has  no  sensible  int 
no  sense  of  order  between  data  values, 
of  distance  that  is  necessary  to  int 
average.  The  only  relation  that  is  de 
scale  of  aeasureaent  is  equivalence, 
the  saae  equivalence  class  as  another 


aanipulated  by  the 
ling  phase.  The  level 
y  not  be  strong  enough 
aetic  to  be  aeaning- 
fined  four  categories; 
atio  (Stevens,  1946; 
56a;  Siegel,  1956b). 

noainal  scale  of 
tion  only,  the  average 
erpretation.  There  is 
auch  less  the  sense 
erprete  the  idea  of  an 
fined  for  a  noainal 
Either  an  object  is  in 
or  it  is  not. 


In  an  ordinal  level  of  aeasureaent,  not  only  is  there  a 
sense  of  equivalence,  but  there  is  an  ordering  relation  as 
well.  The  ordering  relation  may  be  conceived  as  "greater 
than",  "preferred  to",  "lower  than",  "lighter  than",  et 
cetera.  There  is  no  sense  of  distance.  One  can  say  that  an 
object  is  "preferred  to"  another,  but  one  cannot  say  by  how 
much.  This  level  of  aeasureaent  merely  ranics  the  objects  by 
soae  property.  Any  aonotone  transformation  of  the  scale 
provides  an  equivalent  scale. 


with  an  interval  level  of  measure nent ,  the  zero  point 
and  the  unit  of  measurement  are  arbitrary,  but  constant. 
Intervals  between  objects  are  known  and  the  ratio  of  any  two 
intervals  does  not  depend  on  the  unit  of  measurement  or  the 
zero  point.  Any  linear  transformation  of  the  data  results 
in  an  equivalent  scale. 

In  a  ratio  level  of  measurement,  the  scale  has  all  the 
properties  of  an  interval  scale  plus  a  defined  zero  point. 
This  implies  that  the  ratio  of  any  two  values  has  a  meaning¬ 
ful  interpretation;  one  can  judge  that  one  object  is  twice 
another.  Any  transformation  that  leaves  the  ratio  of  two 
values  constant  defines  an  equivalent  scale.  Thus,  the  unit 
of  measurement  is  arbitrary. 

Hany  of  the  advocated  utility  assessment  procedures 
ignore  this  distinction  or  omit  the  scaling  entirely.  For 
eiample,  in  the  Novick  and  Lindley  fixed-state  utility 
assessment  procedure,  it  can  be  shown  that  the  indifference 
probabilities  are  assumed  to  be  from  a  ratio  level,  or 
.scale,  of  measurement  (Edwards,  1965).  This  is  due  to  the 
probabilistic  interpretation  and  the  estimation  procedure. 
This  is  a  strong  assumption  to  make,  particularly  if  the 
procedure  is  used  by  those  who  are  unfamiliar  with  the  gam¬ 
bling  context  of  the  Novick  and  Lindley  procedure  or  the 
notion  of  probability. 


This  assuBption  may  be  relaxed  to  some  extent.  To  this 
end,  two  alternatives  are  available.  One  ii.  to  use  a 
different  data  collection  procedure  in  which  the  natural 
level  of  measurement  is  less  restrictive  (e.g.,  interval  or 
ordinal,  instead  of  ratio) .  This  alternative  has  been  used 
with  success  (Kruskal,  1965;  Green  and  Hind,  1973) .  The 
other  is  to  assume  a  less  restrictive  level  of  measurement 
for  the  indifference  probabilities  and  to  apply  a  scaling 
transformation  to  obtain  the  ratio  level  of  measurement 
required  by  the  estimation  procedure. 

To  provide  the  necessary  background  material  for  the 
scaling,  the  literature  of  multidimensional  scaling  is 
reviewed  in  Chapter  III  (Eckart  and  G.  Young,  1936;  G.  Young 
and  Householder,  1938;  Torgerson,  1952;  Kruskal,  1964; 
Shepard,  1966;  Guttman,  1968;  Carroll  and  Chang,  1970;  F.  H. 
Young,  de  Leeuw,  and  Takane,  1976a).  The  history  of  mul¬ 
tidimensional  scaling  is  traced  from  Eckart  and  G.  Young 
through  the  theories  of  data  and  modelling  of  F.  H.  Young, 
et  alia. 

Following  this,  the  theory  of  data  of  F.  H.  Young  is 
presented  in  detail.  The  theory  is  based  cn  two  concepts: 
level  of  measurement  and  process  of  measurement.  The  level 
of  measurement  is  concerned  with  comparisons  between 
categories  of  objects.  The  different  levels  are  nominal. 
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ordinal,  interval,  and  ratio.  These  levels  have  been 
discussed  above.  The  process  of  neasureoient  is  concerned 
with  conparisons  within  categories.  The  two  processes  of 
■easureaent  are  discrete  and  continuous.  In  a  discrete 
process  of  measurement,  all  objects  in  the  same  category  are 
assumed  to  have  the  sane  value  on  the  scale.  If  two  objects 
have  different  values,  they  are  in  different  categories.  In 
a  continuous  process  of  measurement,  the  categories  are 
defined  by  intervals  of  values,  and  all  objects  having 
values  in  a  given  interval  belong  to  the  same  category. 

The  utility  assessment  procedure  of  Movicic  and  Lindley 
includes  some  scaling  of  the  elicited  data.  These  authors 
argue  that  equal  intervals,  in  the  elicited  data,  near  the 
middle  of  the  scale  and  near  the  tails  of  the  scale  are  not 
equally  meaningful  (Novick  and  Lindley,  1979).  Therefore, 
they  suggest  using  the  logodds  transformation  to  balance  the 
differences.  This  may  be  viewed  as  a  fixed,  non-parametric 
scaling  transformation. 

The  main  purpose  of  reviewing  this  literature  is  to 
show  the  similiarities  between  the  research  in  scaling  and 
in  utility  assessment. 


Section  4.  The  Modelling  Phase 

Once  ve  have  scaled  the  data  that  we  have  collected,  ve 
■ust  proceed  to  the  stage  of  estinating  the  utilities.  He 
do  this  by  proposing  a  aodel  relating  the  utilities  to  the 
data  and  estimating  the  paraneters  of  the  node!  by  sone 
■eans  such  as  the  method  of  least  squares.  Much  of  the  mul¬ 
tidimensional  scaling  literature  is  useful  in  investigating 
the  modelling  phase;  thus,  this  part  of  the  utility  assess¬ 
ment  procedure  is  discussed  in  Chapter  III  as  veil. 

In  the  literature  on  utility  estimation,  however,  most 
of  the  modelling  is  discussed  in  terns  of  conjoint 
measurement.  Background  material  for  conjoint  measurement 
is  presented  in  Chapter  I?.  Two  axiomatizations  are  discus¬ 
sed  (Luce  and  Tukey,  1964;  Boskies,  1965).  Several 
applications  conforming  to  these  axionatizations  are 
presented  (Fishburn  undated;  Keeney  and  Raiffa,  1976; 
Kruskal,  1965;  Green  and  Hind,  1973;  Humphreys  and  Hisuhda, 
1979) .  These  applications  depend  upon  certain  independence 
conditions  that  simplify  the  form  of  the  utility  function. 

One  of  these  conditions  is  called  "additive  indepen¬ 
dence”  (Keeney  and  Raiffa,  1976).  This  condition  holds  if 
and  only  if  preferences  among  gambles  depend  only  on  the 
marginal  probability  distributions  of  the  gambles.  Hhen  the 
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condition  holds,  the  utility  function  is  additive  in  the 
conponents. 

Another  of  these  conditions  is  call  "mutual  utility 
independence"  (Keeney  and  Raiffa,  1976)  .  Under  this  con¬ 
dition,  preferences  among  gambles  involving  each  attribute 
do  not  depend  on  the  levels  of  the  other  attributes.  If 
this  condition  is  satisfied,  then  the  utility  function  is 
multilinear;  i.e.,  it  is  the  sum  of  uniattribute  utility 
functions  and  cross-products  of  uniattribute  utility  func¬ 
tions  , 

The  points  to  be  made  here  are  that  the  conditions  may 
not  be  satisfied  and  that  the  resulting  functional 
limitations  may  not  be  appropriate.  We  must  be  careful  to 
investigate  the  validity  of  the  conditions  and  the  meaning¬ 
fulness  of  the  functional  forms.  It  is  likely  that  an 
additive  utility  function  is  not  reasonable  in  most 
situations.  A  multilinear  utility  function  is  also 
unreasonable  in  many  situations.  In  both  cases,  for  exam¬ 
ple,  the  conditional  utility  functions,  those  of  one 
attribute  for  fixed  values  of  the  others,  are  linear.  While 
these  simplifications  are  useful  under  the  correct  con¬ 
ditions,  they  are  not  generally  applicable.  Hethods  for 
estimating  more  general  multiattribute  utility  functions 
must  be  developed. 
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Tmo  general  theories  of  conjoint  neasureoent  are 
presented  (Tversky,  1967a;  F-  8.  Yeung,  1972).  These  two 
theories  of  polynomial  conjoint  measurement  provide  the 
theoretical  foundation  for  a  more  general  approach  to  the 
estimation  of  multiattribute  utility  functions.  The 
approach  taken  in  Chapter  V  of  this  paper  is  based  on  the 
operational  approach  of  F.  H.  Young,  et  alia  (de  Leeuw,  F. 
H.  Young,  and  Takane,  1976;  F.  8.  Young,  de  Leeuw,  and 
Takane,  1976a;  Takane,  F.  W.  Young,  and  de  Leeuw,  1977;  F. 
W.  Young,  Takane,  and  de  Leeuw,  1978). 

Section  5.  la  latecaediate  Proposal 

In  Chapter  V,  the  various  pieces  are  put  together  to 
form  one  possible  procedure  for  multiattribute  utility 
assessment  using  theories  from  conjoint  measurement  and  mul¬ 
tidimensional  scaling.  The  indifference  probability  assess¬ 
ment  procedure  is  expanded  to  involve  gambles  among  several 
attributes.  The  scaling  transformations  are  developed  for 
several  assumed  levels  of  measurement.  A  polynomial  model 
is  proposed  that  should  be  more  flexible  than  the  additive 
or  the  multiplicative  model. 

Briefly,  the  multiattribute  utility  assessment 
procedure  consists  of  the  three  phases  outlined  in  the 


previous  three  sections:  an  elicitation  phase;  a  coherence 
phase;  and  a  modelling  phase. 

In  the  elicitation  phase,  choices  between  one  mul¬ 
tidimensional  outcome  for  sure  and  a  gamble  involving  two 
other  multidimensional  outcomes  are  presented.  These 
choices  are  used  to  order  the  outcomes  as  well  as  to  elicit 
the  indifference  probabilities  for  the  choices.  Note  that 
if  one  choice  is  selected,  either  the  fcr-sure  outcome  or 
the  gamble,  regardless  of  the  probability  of  the  gamble 
(i.e.,  even  when  the  indifference  probability  is  0  or  1)  , 
then  we  know  that  the  utility  of  the  fcr-sure  outcome  is  not 
between  the  utilities  of  the  outcomes  in  the  gamble.  We  can 
then  reorder  the  outcomes  and  present  a  new  choice. 

The  number  of  possible  choices  is  quite  large.  If 
there  are  d  dimensions  and  N^  is  the  number  cf  points  selec¬ 
ted  along  the  ith  dimension,  then  there  are  (N,*...*N^ 
choose  3)  possible  choices.  For  example,  if  there  are  three 
dimensions  and  seven  points  along  each,  then  there  are 
6,666,891  possible  choices.  By  comparison,  if  there  is  only 
one  dimension  and  seven  points  along  it,  there  are  only  35 
possible  choices. 

It  is  not  practical  to  obtain  indifference 


probabilities  for  every  possible  choice,  nor  is  it  neces¬ 
sary.  If  there  are  three  dimensions  and  seven  points  along 
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each,  then  there  are  twenty-one  margin 
ignoring  for  the  noment  the  scaling 
that  two  parameters  are  fixed,  at  0  an 
marginal  function  along  its  dimension 
parameters  to  estimate. 

Me  could  accomplish  the  same  s 
usual  unidimensional  utility  assessm 
again  assume  that  we  are  interested 
three  dimensions  and  seven  outcomes  al 
have  341  utility  parameters  to  estimat 
approach  makes  no  assumptions  abou 
model.  The  savings  in  parameter 
polynomial  model  advocated  in  this  cha 

The  selection  of  the  choices  m 
One  could  randomly  select  multidimensi 
choices,  but  this  method  would  likel 
user.  Perhaps,  the  choices  could  be  s 
conditional  on  certain  "lines"  thr 
outcomes.  For  example,  one  set  of  c 
points  along  a  single  dimension,  condi 
for  the  other  dimensions.  Another 
involve  points  along  a  "diagonal" 
dimensions  of  outcomes,  holding 
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The  second  phase,  coherence,  and  the  third  phase, 
modelling,  would  be  iterative.  An  initial  scaling  trans¬ 
formation,  an  identity  transformation,  would  be  applied  to 
the  elicited  data.  The  parameters  of  the  model  would  then 
be  estimated  from  this  transformed  data.  Using  the 
estimated  parameters  of  the  model,  predicted  data  would  be 
calculated.  A  new  scaling  transformation  would  then  be 
estimated  using  the  predicted  data  and  the  original  data. 
This  iteration  would  continue  until  convergence  criteria  are 
satisfied . 

Within  the  third  phase,  there  might  be  some 
subiteration.  The  proposed  model  might  be  such  that  rhe 
parameters  cannot  be  estimated  simultaneously  with  ease.  F. 
W.  Young,  et  alia,  have  shown  that  the  method  of  alternat¬ 
ing  least  squares  works  well.  With  this  method,  blocks  of 
parameters  are  estimated  conditionally  on  fixed  values  for 
the  other  parameters.  These  estimates  are  then  taken  to  be 
fixed  and  another  block  of  parameters  is  estimated. 

The  model  proposed  in  this  chapter  is  a  fourth-order 
polynomial.  The  terms  could  be  determined  dynamically:  if 
a  term  accounts  for  at  least  a  certain  percentage  of  the 
total  variation  in  the  data,  then  it  is  included  in  the 
model.  Mote  that  the  parameters  of  the  model  are  not  only 
the  coefficients  of  the  terms  in  the  model.  Since  this  is  a 
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fixed-point  procedure,  the  utilities  along  each  of  the 
dimensions  are  parameters  as  well.  Any  interpolation  of 
utilities  between  specified  outcome  points  is  risky,  but 
useful.  To  facilitate  this  interpolation,  transformations 
from  the  attribute  space  to  the  marginal  utility  spaces  are 
also  estimated  by  fourth-order  polynomials. 

It  should  also  be  noted  that  the  above  presentation  has 
tacitly  implied  that  the  number  of  dimensions  for  utilities 
is  the  same  as  the  number  of  dimensions  for  attributes. 
This  is  not  a  necessary  restriction.  Multidimensional  scal¬ 
ing  is  commonly  used  as  a  dimension-reducing  technique.  It 
also  commonly  assumes  that  the  dimension  of  the  object  space 
is  the  number  of  outcomes.  He  could  apply  the  techniques 
presented  in  this  paper  to  a  set  of  outcomes  that  appear  to 
be  unidimensional  on  the  surface,  but  are  composed  of 
several  underlying  dimensions.  The  procedure  could  then  be 
used  to  estimate  utilities  on  these  underlying  dimensions. 

The  procedure  could  also  be  used  in  reverse.  Suppose 
that  we  measure  outcomes  along  several  dimensions,  but  that 
some  of  the  dimensions  are  redundant.  He  could  use  the 
techniques  presented  here  to  identify  the  utility  space  of 
lower  dimension. 
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Section  6.  Conditional  Expected  Utility  Assessaent 

The  procedure  developed  in  Chapter  V  has  some 
deficiencies  in  conceptualization  and  in  parsinony.  Thus 
the  theories  of  conditional  expected  utility  (Luce  and 
Krantz,  1971;  Fishburn,  1973c)  are  explored  as  an  alter¬ 
native  structure  for  the  aultiattribu te  utility  function  in 
Chapter  VI.  The  axion  systems  of  Luce  and  Krantz  (1971)  and 
of  Fishburn  (1973c)  are  briefly  presented  to  provide  the 
theoretical  background  for  the  proposed  assessment 
procedure. 

Drawing  on  the  two  axiom  systems,  the  concepts  of  a 
marginal  utility  function  and  a  conditional  utility  function 
are  developed-  The  marginal  utility  function  is  defined  as 
the  conditional  expectation  of  the  a ultiattr ibute  utility 
function.  The  conditional  utility  function  is  defined  as  a 
rescaled  utility  function  over  a  subset  of  the  space  of 
interest.  It  is  shown  that  the  conditional  utility  function 
plays  an  integral  part  in  the  assessment  procedure  of  Novick 
and  Lindley  (1979). 
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Section  7.  Hultiattribate  Otility  Assessaent 

Based  on  the  theoretical  background  of  Chapter  VI,  an 
assessoent  procedure  for  the  sarginal  and  conditional 
utility  functions  is  adopted  from  that  of  Novick  and  Lind- 
ley.  Models  for  the  utility  functions  are  chosen  to  be 
cumulative  distribution  functions,  as  suggested  by  Movick 
and  Lindley  (1978).  By  selecting  convenient  cumulative 
distribution  functions,  such  that  the  marginal  and  con¬ 
ditional  distributions  are  nicely  related  to  the  parent 
distribution,  the  parameters  of  the  overall  multiattribute 
(parent)  utility  function  may  be  estimated.  The  normal 
distribution  and  the  Dirichlet  distribution  are  convenient 
candidates.  A  new  distribution,  developed  for  this  applica¬ 
tion  and  called  the  multivariate  generalized  beta 
distribution,  is  also  used. 

The  procedure  will  be  implemented  into  the  Computer- 
Assisted  Data  Analysis  (CADA)  Monitor  (Novick,  Hamer,  Libby, 
Chen,  and  Woodworth,  1980).  It  will  be  limited  to  two- 
dimensional  problems  because  of  computer  memory  restric¬ 
tions.  For  the  sane  reason,  the  scaling  transformations  of 
the  coherence  phase  will  be  limited  to  fixed,  non- parametric 
forms.  Three  forms  will  be  available:  an  identity  trans¬ 
formation,  so  that  the  parameters  of  the  utility  model  are 
estimated  in  the  metric  of  the  indifference  probabilities; 
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the  logodds  transf oraation ,  as  used  by  Novick  and  Lindley 
(1979)  and  currently  implemented  in  the  CADA  Monitor;  and 
the  arcsine-square-root  transformation,  because  of  its 
accepted  use  in  educational  and 
(Moviclc  and  Jackson,  197n)  . 


psychological  research 
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Cha2ter  II.  OTILITT  SLICITATIOM 

Section  (1.  Introduction 

In  this  paper,  we  are  primarily  concerned  with  the 
assessment  of  utilities  for  an  individual.  The  data  consist 
of  repeated  measures  elicited  from  that  individual.  By 
contrast,  if  we  are  estimating  utilities  for  a  group,  then 
the  source  of  error  of  primary  concern  is  across 
individuals.  In  the  former  case,  we  want  to  elicit  a  large 
enough  sample  from  the  individual  so  that  the  errors  of 
measurement  are  reduced.  In  the  latter  case,  we  generally 
want  to  sample  sufficiently  many  individuals  to  accomplish 
the  same  reduction  in  the  error  of  measurement.  In  both 
cases,  we  want  a  large  enough  sample  of  measurements  to 
achieve  stability  of  the  estimates. 

When  we  are  assessing  utilities  for  a  group,  we  use  the 
frequency  of  preference  of  one  object  over  another  to 
measure  the  relationship  of  the  two  objects  (Shepard,  Rom¬ 
ney,  and  Nerlove,  1972;  Green  and  Wind,  1973)  We  use  the 
relative  frequency  of  preferences  both  to  determine  the 
ordinal  characteristics  (i.e.,  which  has  greater  utility) 
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and  to  scale  the  objects  in  teems  of  distances  (i.e.,  how 
■uch  greater  utility  the  one  has  compared  to  the  other) .  If 
one  object  is  preferred  over  another  by  a  large  majority  of 
the  sample  and  a  third  over  a  fourth  by  a  small  majority  of 
the  sample,  one  would  say  that  the  two  objects  of  the  first 
pair  were  more  “distant"  from  each  other  than  the  two 
objects  of  the  second  pair.  The  strength  of  the  interval 
relationship  is  determined  by  the  proportion  of  the  sample 
that  prefers  the  one  object  over  the  other. 

When  we  are  assessing  utilities  for  individuals,  we  do 
not  have  the  same  type  of  information  from  which  to  draw 
inferences.  We  have  a  sample  of  one,  using  the  same 
context.  He  must  use  the  sample  of  responses  from  that  one 
individual  to  estimate  the  utilities,  but  the  responses  must 
be  of  a  different  nature  than  a  simple  statement  of 
preference  between  two  objects.  Such  an  elicitation  would 
be  rather  transparent,  since  the  individual  would  liJcely 
remember  the  preference  stated  for  previous  presentations  of 
the  pair  of  objects,  and  thus  would  not  provide  as  much 
information  to  us  for  our  efforts  as  it  might  appear.  The 
strongest  statement  we  could  make  from  such  evidence  would 
concern  only  the  ordinal  characteristics  of  the  utilities, 
and  that  would  not  be  very  strongly  supported. 

In  order  to  obtain  more  information,  there  are  several 
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feasible  alternatives.  One  alternative  is  to  present  two 
pairs  of  objects  and  to  elicit  Hhich  pair  is  thought  to  be 
further  apart  (Suppes  and  Rinet,  1955;  Hayekava,  1980). 
This  coaparison  on  an  interval  scale  is  appealing  as  we  are 
are  attempting  to  assess  interval-scaled  utilities. 

Another  alternative  is  to  elicit  a  statement  about  the 
magnitude  of  the  interval  between  two  objects.  This 
procedure  might  be  difficulty  and  thus  unreliable,  because 
of  the  lack  of  a  standard  for  comparison.  To  structure  this 
procedure  a  bit,  we  might  consider  three  objects,  instead  of 
two,  and  ask  how  much  further  the  third  is  from  the  first 
than  the  second  is  from  the  first. 

This  latter  procedure  captures  in  essence  one 
interpretation  of  an  elicitation  procedure  based  on  the 
theory  of  expected  utilities  (von  Neumann  and  Morgenstern, 
1947;  Savage,  1954).  The  next  section  presents  the 
axiomatizations  of  utility  by  von  Neumann  and  Morgenstern 
and  by  Savage.  In  the  third  section,  two  classes  of 
procedures  based  on  the  theory  of  expected  utility  are 
investigated:  fixed-probability  utility  assessment  and 
fixed-state  utility  assessment.  In  the  fourth  section  of 
the  chapter,  the  fixed-state  procedure  advocated  by  Novick 
and  Lindley  (1979)  is  discussed  in  detail.  In  the  final 
section,  some  enhancements  for  the  No vick-Lindley  procedure 


are  presented. 


Section  2.  Expected  Qtility  Azioeatizations 

In  this  section,  two  axiomatizaticns  of  expected 
utility  are  presented.  The  axioas  of  von  Neumann  and  Mor- 
genstern  (1947)  are  listed  in  Table  II. 2.1.  Those  of  Savage 
(1954)  are  listed  in  Table  II. 2. 2.  These  axiomatizations 
are  presented  here  for  completeness  and  are  not  discussed  in 
detail. 

The  axioaatization  of  von  Neumann  and  Horgenstern  was 
the  first  concerted  axiom  system  for  the  concept  of  expected 
utility.  The  concepts  may  be  traced  back  to  the  works  of 
Ramsey  (1960)  and  de  Finetti  (1974)  .  The  axiom  system  of 
savage  generalizes  the  system  of  von  Neumann  and  Horgenstern 
somewhat  and  presents  it  in  a  more  rigorcus  fashion. 


Section  3.  Ezpected-Otility  Assessment  Procedures 

In  this  section  we  present  two  classes  of  procedures 
based  on  the  theory  of  expected  utility.  The  procedures  in 
one  class  are  called  fixed-state  procedures,  and  those  in 
the  other  class  are  called  fixed-probahility  procedures. 
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Table  11-2.1 

Axioaatization  of  Utility 
(von  Keuaann  and  Morgenstern  19<47) 

We  consider  a  systen  0  of  utilities  u,  v,  w,  ....  In  0  a 
relation  is  given,  u  >  v,  and  for  any  nuiber  a,  (0<a<1),  an 
operation 


au  ♦  (1-a) V  =  u . 

These  concepts  satisfy  the  following  axioas: 

A  u  >  V  is  a  coaplete  ordering  of  0. 

A:a  For  any  two  u,  v,  one  and  only  one  of  the  three  follow¬ 
ing  relations  holds: 

u=v,  u>v,u<v. 

A:b  u  >  v,  V  >  w  iaply  u  >  w. 

B  Ordering  and  coabining 

B;a  u  <  V  iaplies  that  u  <  au  ♦  (1-a)v 

B:b  u  >  V  iaplies  that  u  >  au  ♦  (l-d)v 

B:c  u  <  w  <  V  implies  the  existence  of  an  a  with 


au  ♦  (1-a)v  <  w. 
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Table  II.2.J 
(continued) 

B:d  u  >  w  >  V  inplies  the  existence  of  an  a  with 

au  ♦  (1~a) V  >  H . 

C  Algebra  of  conbining 
C:a  au  ♦  (1-a)v  =  (1-a)v  ♦  au 

C:b  a(bu  ♦  (1-b)  v)  ♦  (l-a)v  =  cu  ♦  (1-c)v,  where  c 


=  ab. 
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Ta^e  1 1- 2. 2 

Axiomatization  of  Dtility 
(Savage  195^) 

In  the  following  postulates  (P1-P6),  let  S  be  the 
universal  event,  a  set  of  states  containing  all  the  states 
of  the  world,  with  generic  eleuent  s;  let  A  and  B  be  events, 
subsets  of  S;  let  f,  f,  g,  g*,  denote  consequences;  let 

•  be  acts,  functions  that  attach  a  specific 
consequence  f  (s)  ,  f'(s),  g  (s)  ,  g'(s),  respectively,  to  each 
state  of  the  world  s;  and  let  ^  denote  acts 
conditioned  on  the  event  A,  or  E,  obtaining. 


PI 

The  relation  <= 

is  a  simple  ordering 

among 

acts . 

P2 

If  3. 

and  , 

y'  are  such  that: 

1. 

in 

n  agrees  with  fi  ,  and 

ft '  agrees  with  y ' , 

2. 

in  B,  5 

agrees  with  i^’,  and 

y  agrees  with  y ' , 

3. 

A 

II 

then  1^' 

A 

II 

P3 

M 

11 

9.  r 

=  g’,  and  B  is  not 

null : 

then  ^  <= 

given  B, 

if  and 

only  if  g  <=  g*. 
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Table  II. 2. 2 
(continued) 


P4 


P5 


Pb 


f. 

g. 

g  '  ;  A  ,  B  ; 

■'■b' 

'a'  • 

■  are 

■B 

such  that; 

1. 

f  • 

A 

II 

g’ 

<= 

g: 

2a . 

f 

A 

|S)  =  f. 

"a 

IS) 

= 

g» 

for 

s 

in  A 

f 

A 

(S)  -  f. 

^A 

(S) 

= 

g '  / 

for 

s 

not  in  K; 

2b. 

f 

D 

(S)  =  f. 

(S) 

= 

g. 

for 

s 

in  B 

f 

B 

(s)  =  £', 

(S) 

= 

g  ’ . 

for 

s 

not  in  B; 

3. 

<=  .  ; 

■B 

then  ,  <= 


■'A  -'’B 

There  is  at  least  one  pair  of  consequences  f,  f  such 


that  f'  <  f. 

If  ;i  <  li ,  and  f  is  any  consequence;  then  there  exists  a 
partition  of  S  such  that,  if  ■  or  •  is  modified  on  any 
one  element  of  the  partition  as  to  take  the  value  f  at 
every  s  there,  the  other  values  being  undisturbed,  then 
the  modified  .(  remains  less  than  i.  ,  or  remains  less 
than  the  modified  i.,  as  the  case  may  require. 
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These  tuo  classes  have  been  well  researched  and  criticized 
(Friedfflan  and  Savage,  19h8;  Hosteller  and  Hogee,  1951; 
Coonbs,  1975;  Kahneaann  and  Tverslcy,  1979;  Ncvick  and  Lind- 
ley,  1979;  tiovick.  Turner,  and  Novick,  1981).  The 
criticisms  are  discussed  here  in  order  to  justify  the  selec¬ 
tion  of  the  fixed-state  procedure  of  Movick  and  Lindley  as 
the  method  for  elicitation  in  this  paper. 

The  two  classes  of  procedures  are  based  on  the  theory 
of  expected  utility.  Both  assume  that  there  are  three 
distinct  outcomes  or  objects,  which  are  ordered  according  to 
perceived  value  or  utility.  Two  alternatives  are  presented: 
the  object  of  middle  value  nay  be  selected  for  sure,  or  a 
gamble  may  be  selected  involving  the  other  two  objects.  If 
the  for-sure  alternative  were  selected,  then  the  object  of 
middle  value  would  be  obtained  unconditionally,  in  this 
hypothetical  choice.  If  the  gamble  were  selected,  the 
object  of  higher  utility  would  be  obtained  with  probability 
p  and  the  object  with  lower  utility  would  be  obtained  with 
probability  1-p.  For  certain  objects  and  probabilities,  the 
expected  utilities  of  the  two  alternatives  would  be  equal. 

In  the  fixed-probability  procedures,  the  value  of  the 
probability  p  is  fixed,  and  the  value  of  one  of  the  three 
objects  is  varied  until  the  utility  of  the  for-sure  alter¬ 
native  is  equal  to  the  expected  utility  of  the  gamble.  In 


33 


some  cases  it  is  the  object  of  middle  value,  the  for-sure 
object,  that  is  varied;  in  some  cases  it  is  the  higher¬ 
valued  object  that  is  varied.  The  middle- valued  object  is 
called  the  "certainty  equivalent"  of  the  gamble. 

In  the  fixed-state  procedures,  the  three  object  are 
fixed  and  the  value  of  the  probability  that  makes  the  expec¬ 
ted  utilities  of  the  for -sure  alternative  and  the  gamble 
alternative  equal  is  ascertained.  This  probability  is  cal¬ 
led  the  "indifference  probability,"  as  one  would  be 
indifferent  to  a  choice  between  the  for-sure  alternative  and 
the  gamble  with  such  a  probability. 

The  two  classes  of  procedures  may  be  compared  on 
several  levels.  One  is  concerned  with  coherence  in  judgment 
(Novick  and  Lindley,  1979).  If  we  elicit  subjective  judg¬ 
ments  on  related  quantities,  we  want  them  to  agree.  In 
eliciting  judgments  in  the  assessment  of  utilities,  we  want 
to  elicit  more  judgments  than  are  necessary  to  estimate  the 
unknown  utility  parameters.  Thus,  the  assessee  has  an 
opportunity  to  see  the  effects  of  incoherent  judgment. 

The  ease  of  coherence  checking  is  not  egual  between  the 
fixed-state  and  the  f i x ed-proba bil it y  procedures  (Novick  and 
hindley,  1979).  For  example,  in  the  fixed-probability 
()rocedure,  fixing  tlie  probability  at  one  half,  we  might  find 
the  certainty  equivalent  of  an  even-odds  gamble  between  the 
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worst  state,  say  ,  and  the  best  state,  say  u^.  Calling 
this  state  G  ^  and  assuBing  "he  utility  of  0^  to  be  0  and 
the  utility  of  0  to  be  1  (i.e.,  u(Gq)=0  and  u(ij]^)=1),  we 
would  set  u (e  ^)=.5.  Ve  could  then  elicit  the  certainty 
equivalents  for  even-odds  ganbles  between  6^  and  0  ^  and 
between  u  ^  and  0^.  As  these  certainty  equivalents  would 
have  utilities  .25  and  .75,  respectively,  we  might  call  them 
0  25  and  ^75'  were  to  then  elicit  the  certainty 
equivalent  for  an  even-odds  gamble  between  6  ^5  and  ^75#  if 
would  be  rather  obvious  that  it  should  be  G  ^ .  Hence,  we 
would  not  be  getting  observations  that  were  independent 
enough  to  check  for  coherence. 

The  fixed-state  procedures  seem  to  not  be  affected  as 
much  by  this  difficulty  in  coherence  checking.  In  the  next 
section,  several  algorithms  that  have  been  developed  for 
this  purpose  are  discussed. 

One  criticism  that  appears  to  affect  procedures  from 
both  classes  stems  from  an  "anchoring  and  adjustment" 
phenomenon  (Tversky  and  Kahnemann,  1974) .  It  is 
hypothesized  that  the  first  response  acts  as  an  "anchor"  and 
subsequent  responses  are  adjustments  from  the  initial 
response.  In  addition,  it  appears  that  in  both  the  fixed- 
state  and  the  fixed-probability  procedures,  estimates  of  the 
extremes  tend  to  be  con  s  e  i- va  t  i  vc  .  More  reseiich  i  ■.  being 
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conducted  in  this  area  (Novick,  Turner,  and  Novick,  1981). 


Section  4.  The  Movick  and  Lindley  Procedure 

The  procedure  advocated  by  Novick  and  Lindley  (1979)  is 
a  fixed-state  procedure-  In  this  section  we  present  the 
procedure  in  detail-  The  implementation  of  the  procedure 
(Isaacs  and  Novick,  1978)  and  its  subsequent  enhancement 
(Novick,  Hamer,  Libby,  Chen,  and  Hoodwortb,  1980)  are  also 
discussed.  In  the  following  section,  additional 
enhancements  are  suggested.  Although  much  of  the  discussion 
of  the  implementation  of  the  procedure  is  concerned  with 
modelling  and  estimation,  rather  than  elicitation,  it  is 
included  here  for  reasons  of  continuity  and  completeness. 

The  Novick  and  Lindley  fixed-state  utility  assessment 
procedure  is  based  on  the  theory  of  expected  utility  in  the 
following  way.  It  assumes  that  we  have  a  set  _  of  n^l 
states  in  which  we  are  interested;  we  will  name  these  states 
jg  ,  ''If  *  •  *  '  "n  '  assumes  that  we  can  order  these  states 
such  that  'g  <p  '  <P  <P  -'p,*  where  "<p''  is  interpreted 
as  "less  preferred  than."  Note  that  the  preference  ordering 
is  assumed  to  be  strict;  it  is  not  permitted  that  two  states 
are  equally  preferred,  or  that  one  is  indifferent  in  a 
choice  between  two  states.  (This  assumption  is  for 


of  the 


explanatory  convenience.  Any  implenentation 
procedure  should  be  able  to  deternine  when  two  states  are 
preferentially  equivalent  and  to  adjust  the  nodel  accor¬ 
dingly.  This  topic  is  discussed  in  more  detail  in  Chapter 

VII  when  the  procedure  boiny  advocated  in  this  yapor  js 
presented . ) 
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(II. 4.1)  u(0j)  =  P  u(Oj^)  +  (1-p) 

is  true,  where  u(.)  is  the  utility  transformation.  Since 
the  indifference  probability  p  varies  depending  on  the 
situation,  i.e.,  on  the  choice  of  i,  j,  and  k,  we  will  refer 
to  a  specific  value  as  p.  ,  . 

1  J  K 

It  is  this  utility  transformation  that  we  are  attempt¬ 
ing  to  estimate.  There  are,  however,  some  assumptions  that 
we  make  about  its  form.  First,  it  is  a  discrete  trans¬ 
formation.  Se  are  not  trying  to  find  a  parametric  fit  for 
the  set  of  all  possible  states  (our  set  ^  is  a  subset  of 
this  set)  .  We  are  merely  attempting  to  find  a  value  to 
associate  with  each  element  ^  in  the  set  v.  Second,  we 
associate  a  utility  of  0  with  the  least  preferred  state  in 
and  a  utility  of  1  with  the  most  preferred  state.  If  we  are 
aiming  for  an  interval  level  of  measurement  with  our  utility 
transformation,  this  second  assumption  only  restricts  us 
enough  to  make  the  necessary  estimates,  because  an  interval 
level  of  measurement  is  unique  only  up  to  a  linear  trans¬ 
formation  . 

Since  equation  (II. 4.1)  involves  three  utilities  and 
the  second  assumption  specifies  two  utilities  in  the  set  to 
have  fixed  values,  we  can  solve  the  system  of  equations  in 
the  form  of  equation  (II. 4.1)  if  we  can  arrange  each  equa¬ 
tion  so  that  it  involves  two  utilities  that  we  know  and  only 


one  that  we  do  not  know.  To  accosplish  this,  it  is  con¬ 
venient  tc  select  the  states  0j,  and  9]^  so  that  they  are 
•adjacent,’  i.e.,  we  select  ®j»  ^nd  ®j+i  ■  Equation 

(11. 4.1)  then  becoaes 

(11. 4. 2)  u(0^)  =  p  ^(0^^^)  +  (1-p)  u(6j_j^). 

Since  the  indifference  probability  p  here  depends  on  the 
selection  of  j  only,  we  will  refer  to  a  specific  value  as 
Pj.  He  can  now  rearrange  equation  (II. 4. 2)  so  that  it 
involves  differences  between  the  utilities  of  adjacent 
states 


(II. 4. 3) 

Pj  U(0j) 

+  (1-Pj)  u(0j 

)  =  Pj  +  +  (1-Pj) 

(II. 4. 4) 

Pj[u(0j^l 

)  -  u{9j)  ]  = 

(1-p^)  [u(0j)  -  ) 

/1-P 

-i\ 

(II. 4. 5) 

u(Oj^i)  - 

“<'>3'  '  ( Pi 

(u(0  .)  -  u(0  ._^)] 

If  we  define  fj  =  (1-p^)/Pj»  then  equation  (II. 4. 5)  becomes 

(11. 4. 6)  -  u(0j)  =  fj[u(ej)  -  u(9j_^)l. 

Substituting  equation  (II. 4.6)  for  j=j*-1  into  the  equation 
for  j=j*  and  repeating  the  substitution,  we  arrive  at 

(11. 4. 7)  u{0.^^)  -  u(0.)  =  (iiifi)  u(O^) 

since  we  have  constrained  u(0q)  =  0.  If  we  then  sun 


equations  (II. 4. 7)  over  j  from  0  to  Jc  (and  defining 
Me  get 
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=  1), 


(II. 4 .8)  y 
If  Jc+1  =  n  then 


■k  !  j 
r  .v 
1  =  0  Vi=i 


u  ( 0  ^ )  . 


.9) 

U(0  )  - 

•“  n-l 

V 

(■*■)! 

n 

_  1  =  0 

'i  =  0  ^ 

Since  Me  have  constrained  u(0  i 

n ' 

from  knoMn  quantities.  KnoMing 
utility  of  the  other  states 


=  1,  we  can  calculate  u(r^) 
u(o^),  H6  can  calculate  the 
successively  using  equation 


(II. 4. 5) . 


This  development  does  not  use  the  concept  of  coherence 
checking.  Se  are  assuming  only  as  much  information  as  is 
needed  to  uniquely  determine  the  utilities.  To  check 
coherence,  we  need  to  collect  more  information  on  the 
relationships  among  the  utilities,  i.e.,  we  need  to  elicit 
indifference  probabilities  for  more  gambles.  There  are 
three  methods  that  have  been  developed  to  check  for 
coherence:  local-coherence  assessment,  regional-coherence 
assessment,  and  least-squares  assessment  (Isaacs  and  Novick, 
1978;  Novick  and  Lindley,  1979;  Novick,  DeKeyrel,  and 
Chuang,  1979;  Novick,  Hamer,  Libby,  Chen,  and  Hoodworth, 
1980;  Novick,  Turner,  and  Novick,  1981). 

In  the  regional-coherence  assessment  procedure,  adjust- 
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In  the  local-coherence  assessnent  procedure,  adjustnent 
is  made  for  each  situation  in  which  a  choice  is  Bade  between 
a  for-sure  state  and  a  gamble  involving  two  other  states. 
An  indifference  probability  is  elicited.  From  this 
information,  two  gambles  are  constructed,  each  involving  two 
of  the  three  states,  such  that  a  choice  between  the  two  gam¬ 
bles  should  be  indifferent.  If  one  of  the  gambles  is 
preferred,  the  probability  of  one  of  the  gambles  is 
modified,  thus  changing  the  indifference  probability  in  the 


original  choice,  so  that  neither  gamble  is  preferred  over 
the  other.  Once  all  the  probabilities  are  acceptable, 
another  set  of  three  states  is  presented  in  the  same  way. 
Hhen  enough  sets  have  been  presented  so  that  all  the 
utilities  can  be  uniquely  determined,  the  iteration  stops. 

The  least-squares  assessment  procedure  allows  adjust¬ 
ment  only  after  all  situations  have  been  presented.  For 
this  reason,  the  procedure  might  be  called  a  global- 
coherence  assessment  procedure  as  well.  Indifference 
probabilities  ate  elicited  for  each  situation  presented,  as 
in  the  other  assessment  procedures,  but  mote  situations  are 
presented  than  are  necessary  to  uniquely  determine  the 
utilities.  Therefore,  it  is  unlikely  that  there  is  a  solu¬ 
tion  that  exactly  fits  all  of  the  equations  in  expected 
utility.  To  estimate  the  utilities,  a  least-squares  solu¬ 
tion  is  calculated. 

In  the  least-squares  methodology,  we  assume  that  our 
observations,  in  this  case  the  indifference  probabilities 
Pj ,  contain  some  (unknown)  amount  of  error,  which  may  be 
random  or  systematic.  Thus,  the  estimated  model  is  not 
expected  to  fit  the  observations  exactly.  The  parameters  in 
the  model  are  estimated  to  minimize  the  squared  deviations 
of  the  observations  from  the  corresponding  values  projected 
by  the  model. 
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Because  of  the  importance  to  the  estimation  of  the 
model,  it  is  necessary  to  consider  carefully  the  metric  in 
which  to  make  the  comparison  between  the  observations  and 
the  estimated  model.  One  possible  metric  is  that  of  the 
indifference  probabilities  themselves.  Equation  (II. 4.1) 
can  be  rearranged  to  give 

U  (  <'  )  -  U  (  0  ^  ) 

(II. 4. 10) 

K  1 

from  which  we  can  obtain  estimates  of  the  indifference 
probabilities  conditional  on  the  estimates  of  the  utilities 


u  ( 0  ^ )  -  u  { 0  ^ ) 
-  u{e\)' 


One  could,  then,  estimate  the  utilities  to  minimize  the  sum 
of  squared  differences  between  and  Pj^jj^- 

Novic)c  and  Lindley  (1979)  have  argued  that  the 
precision  of  the  logodds  of  the  indifference  probabilities 
is  the  crucial  factor  in  the  analysis.  Note  that  equation 
(II. 4.1)  can  also  be  rearranged  to  produce 


(II. 4, 12) 
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and  the  corresponding  estimates 
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(II. 4.  13)  _ „ _ J _ iL 

The  least-squares  solution  advocated  by  Novick  and  Lindley 
is,  thus,  the  set  of  utilities  that  minimizes  the  equation 


(II. 4. 14) 
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Research  has  shown  (Mayekawa,  1981)  that  use  of  the  logodds 
metric  does  not  appreciably  improve  the  estimation  over  the 
use  of  the  metric  of  the  indifference  probabilities  or  the 
arcsine  metric. 


Section  5.  Enhancements  to  the  Procedure 

There  are  two  enhancements  noted  here  for  the  original 
implementation  of  the  Novick  and  Lindley  least-squares 
fixed-state  utility  assessment  procedure  (Isaacs  and  Novick, 
1970).  Although  they  are  more  relevant  to  the  implementa¬ 
tion  of  the  procedure  being  advocated  in  this  paper,  they 
are  mentioned  here  for  continuity. 

The  first  enhancement  is  concerned  with  the  numerical 
method  used  in  the  nonlinear  estimation.  The  method  is  a 
Newton-Raphson  method  (Dahlquist,  Bjork,  and  Anderson,  1974; 
Kennedy  and  Gentle,  1980)  such  that 


(II. 5.1)  u  -  u'  -  iiti 

where  u  is  a  previous  estimate  of  the  utilities,  u'  is  the 
new  estimate  of  the  utilities,  g  is  a  vector  of  first 
derivatives  of  the  function  to  be  minimized  (equation 
II.4.1U),  and  H  is  the  inverse  of  the  matrix  of  second 
derivatives  (the  Hessian  matrix)  of  the  function  to  be 
minimized.  All  derivatives  are  with  respect  to  the  utility 
parameters.  Table  II. 5.1  presents  these  first  and  second 
derivatives. 

The  original  implementation  of  the  Novick-Lindley 
procedure  did  not  use  the  full  expressions  for  the  calcula¬ 
tion  of  the  Hessian  matrix  of  second  derivatives.  In  each 
of  the  sums  for  the  second  derivatives  in  Table  II. 5.1,  cnly 
the  first  term  within  the  brackets  was  used.  The  justifica¬ 
tion  was  based  on  the  expectation  that  the  difference 
between  the  two  log  terms  would  be  sufficiently  close  to 
zero  to  make  its  contribution  to  the  second  term  within  the 
brackets  negligible. 

The  first  enhancement  is  to  use  the  full  expression  for 
the  second  derivatives.  It  appears  that  this  enhancement 
lessens  the  likelihood  of  obtaining  utility  estimates  that 
are  not  monotonic.  (The  constraints  imposed  by  the  model 
theoretically  guarantee  that  the  utility  estimates  will  be 
monotonic.  With  computational  inaccuracies  due  to  the 
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liaited  precision  of  the  coaputing  environment,  however,  the 
theoretical  constraints  are  not  sufficient,  especially  when 
the  utilities  of  two  states  are  very  close.)  This 
e nhincement  has  been  implemented  in  the  1980  release  of  the 
CADA  Monitor  (Novic)c,  Hamer,  Libby,  Chen,  and  Woodworth, 
1980).  Other  intricacies  of  the  algorithm  are  discussed 
later. 

The  second  enhancement  is  concerned  with  the  algorithm 
used  to  calculate  initial  estimates  fcr  the  utilities. 
Since  the  estimation  algorithm  is  an  iterative  improvement 
algorithm,  it  requires  a  starting  point.  The  current 
implementation  of  the  Novick-Lindley  procedure  requires  that 
all  the  adjacent  gambles  be  used  to  calculate  the  initial 
estimates.  Although  it  may  be  that  the  adjacent  garaLies  are 
easiest  and  most  accurate  to  elicit  (Ncvick,  Turner,  and 
Novick,  1981)  and  therefore  would  always  be  available,  this 
restriction  is  unnecessary.  All  that  is  required  is  a  set 
of  non- linearly-related  gambles  involving  all  the  states. 
While  the  numerical  analysis  needed  to  check  the  conditions 
is  more  complicated  than  the  currently  implemented  scheme, 
the  increase  in  flexibility  for  the  decision  maker  more  than 
offsets  this  disadvantage.  (The  initial  utility  estimates 
are  calculated  in  the  ne'tric  of  the  i  n  di  f  f  er  c-nci 
p  I  oba  b  i  1 1 1  1  fs  .  )  This  t  ii  h.i  lu:  e  m  en  t  tus  lut  liti,  i  m  [  1 1  m<  ■  ii  1 1 


in  the  C  A  I '  A  Monitor, 


Chafiter  HOLTIDIBEMSIO SAL  SCALI^ 

Section  1.  Introdaction 

In  this  chapter,  «e  will  present  the  backgrcuna 
material  needed  for  the  development  of  one  approach  to  the 
utility  asses.sment  procedure  that  is  the  gcal  or  this  paper. 
To  this  purpose,  the  chapter  is  divided  into  four  sections, 
including  this  one. 

Section  2  presents  a  brief  history  of  multidimensional 
scaling.  The  works  of  Hotelling  (1933),  concerning  the 
principal  components  decomposition,  cf  hckart  and  G.  Young 
(1936),  concerning  the  approximation  of  a  matrix  by  another 
of  lower  rank,  and  of  G.  Young  and  Householder  {193«)  , 
concerning  the  representation  of  a  set  of  points  in  terms  of 
their  mutual  distances,  stand  as  the  foundation  upon  which 
accomplishments  in  the  field  of  multidimensional  scaling  are 
built.  Torgerscn  (1952)  developed  these  ideas  into  >  theory 
and  method  of  multidimensional  scaling,  noting  that  t  lit 
dimensions  in  psychological,  as  opposed  to  psychophysical, 
scaling  arc  often  unknown  or  confounded. 
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Kruskal  and  Shepard  (Kruskal,  1964;  Shepard  and 
Kruskal,  1964;  Shepard,  1966)  expanded  the  concepts 
developed  by  Torgerson  to  include  nonmetric  stimuli  (i.e., 
ordinal)  as  well  as  metric  stimuli.  The  analysis  of  group 
scaling  was  developed  by  Bloxom  (1968),  Carroll  and  Chang 
(1970),  and  Schonemann  (1972).  This  has  been  called  the 
"individual  differences"  model.  In  this  paradigm,  it  is 
assumed  that  data  have  been  collected  from  several  sources 
(e.g.,  individuals)  that  have  a  common  underlying  structure 
but  different  perceptions  of  that  structure.  The 
differences  in  perception  may  include  heterogeneous  weight¬ 
ing  of  the  component  axes  or  heterogeneous  rotations  of  the 
axes. 


nuch  of  the  current  work  in  multidimensional  scaling  is 
being  done  by  F.  W.  Young,  et  alia  (de  Leeuw  and 
Pruzansky,  1976;  de  Leeuw,  Young,  and  Takane,  1976;  Takane, 
Young,  and  de  Leeuw,  1977;  Young,  1975;  Young,  de  Leeuw,  and 
Takane,  1976a;  Young,  de  Leeuw,  and  Takane,  1976b;  Young, 
Takane,  and  de  Leeuw,  1978).  h  comprehensive  theory  of  data 
and  modelling  has  been  developed  that  includes  both  metric 
and  nonmetric  scaling,  and  the  many  common  models  in  mul¬ 
tidimensional  scaling  such  as  the  additive  model,  the 
regression  model,  the  individual  differences  model,  and  the 
principal  components  model. 


Section  3  presents  the  theory  of  data  and  modelling  of 
F.  W.  Young,  et  alia.  The  theory  of  data  is  structured 
using  the  level  of  measurement  (nominal,  ordinal,  interval, 
and  ratio)  and  the  process  of  measurement  (discrete  and 
continuous) .  This  theory  of  data  forms  the  basis  for  the 
scaling  phase  of  the  algorithm  presented  by  F.  W.  Young, 
et  alia,  called  Alternating  Least  Squares  with  Optimal  Scal¬ 
ing  (ALSOS) .  As  the  multiattribute  utility  assessment 
procedure  presented  in  this  paper  uses  this  algorithm  as  a 
base  structure,  the  ALSOS  algorithm  is  discussed  in  detail. 

In  Section  4,  various  topics  in  multiattribute  utility 
assessment  that  use  the  language  and  structure  of  mul¬ 
tidimensional  scaling  are  presented.  Most  of  these 
applications  use  the  additive  model  (e.g..  Green  and  Wind, 
1973;  Kruskal,  1965) .  Some  use  of  the  individual 
differences  model  has  also  been  made  (Green  and  Wind,  1973). 

Section  2.  The  History  of  Baltidimens ional  Scaling 

One  of  the  initial  attempts  to  view  a  matrix  as  a 
projection  from  some  set  of  axes  different  from  the  apparent 
axes  of  the  observed  measurements  is  due  to  Hotelling 
(1933).  In  his  paper.  Hotelling  shows  that  one  can 
construct  a  set  of  axes  such  that  each  axis  represents  the 


diaensioQ  of  largest  variation  in  the  observed  values  that 
is  orthogonal  to  the  other  axes. 

Hotelling's  paper,  and  results  due  to  Courant  and  Hil¬ 
bert  (Eckart  and  G.  Young,  1936) ,  were  used  by  Eckart  and 
G.  Young  (1936)  to  deteraine  the  closest  approximation  to  a 
given  matrix  so  that  the  approximation  is  of  lower  rank. 
The  solution  is  based  on  two  results  by  Courant  and  Hilbert. 
The  first  states  that  any  real  matrix  may  be  decomposed: 

For  any  real  matrix  A,  two  orthogcnal  matrices  7 
and  v'  can  ce  found  so  that  L  =  VAU'  is  a  real 
diagonal  aatrii  with  no  negative  elements. 

This  theorem  shows  that  a  decomposition  of  a  real  matrix 
exists.  The  second  theorem,  also  due  to  Courant  and  Hil¬ 
bert,  shows  the  conditions  under  which  a  matrix  of  lower 
rank  that  closely  approximates  a  given  matrix  may  be  found: 

If  AB'  and  B'A  are  both  symmetric  matrices,  then 
and  only  then  can  two  orthogonal  matrices  V  and  0 
be  found  such  that  L  =  VAU’  and  M  =  VEU'  are  both 
real  diagonal  matrices. 

The  solution  to  the  problem  of  finding  an  approximation  to  a 
matrix  that  has  a  lower  rank,  say  r,  is  to  decompose  the 
matrix  as  indicated  in  the  first  theorem  and  use  the  first  r 
rows  and  columns  of  the  resulting  decomposition  and  the 
second  theorem  to  construct  the  approximating  matrix. 

Another  basic  result  is  the  representation  of  a  set  of 
points  in  Euclidean  space  in  terms  of  their  mutual  distances 
(G.  Young  and  Householder,  1938).  In  this  paper,  it  is 


shown  that  under  certain  conditions,  a  set  of  numbers  may  be 
conceived  as  mutual  distances  of  a  set  of  points  in 
Euclidean  space.  Matrices  are  also  found  in  the  paper  whose 
ranks  determine  the  smallest  Euclidean  space  containing  such 
points.  The  results  of  Eckart  and  G.  ioung  are  then 
applied  so  that  the  representation  of  the  set  of  numbers  may 
be  approximated  by  a  set  of  points  in  an  Euclidean  space  of 
lower  dimensionality. 


These  results  may  be  applied  to  any  set  of  numbers  that 
may  be  interpreted  as  measurements  of  distances  among  a  set 
of  objects.  The  implications  of  these  results  were  expres¬ 
sed  by  Torgerson  (1952)  as  follows: 

The  traditional  methods  of  psychophysical  scaling 
presupposes  knowledge  of  the  dimensions  of  the 
area  being  investigated.  The  methods  require 
judgments  along  a  particular  defined  dimension, 
i.e.,  A  is  brighter,  twice  as  loud,  more  conser¬ 
vative,  or  lieavier  than  B.  The  observer,  of 
course,  must  know  what  the  experimenter  means  by 
brightness,  loudness,  etc.  In  many  stimulus 
domains,  however,  the  dimensions  themselves,  or 
even  the  number  of  relevant  dimensions,  are  not 
know  ;.  What  might  appear  intuitively  to  be  a 
single  dimension  may  in  fact  be  a  complex  of 
several.  Some  of  the  intuitively  given  dimensions 
may  not  be  necessary  --  it  may  be  that  they  can  be 
accounted  for  by  linear  combinations  of  others. 

Other  dimensions  of  importance  may  be  completely 
overlooked.  In  such  areas  the  traditional 
approach  is  inadequate. 

The  results  of  G.  Young  and  Householder  are  not  directly 
applicable  to  the  type  of  problems  ennunciated  by  Torgerson. 
The  work  of  the  former  authors  presupposes  infallible  data. 
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The  data  from  the  oft-cited  real  world  that  Torgerson  wishes 
to  analyze  are  likely  to  be  distorted  by  errors  of 
oeasurement . 

The  crucial  aspect  is  in  the  measurement  of  the 
distances  between  the  objects.  The  origin  of  the  Euclidean 
space  being  determined  is  unknown.  Young  and  Householder  do 
not  address  this  issue,  instead  choosing  one  of  the  objects 
to  represent  the  origin.  There  are,  then,  an  infinity  of 
solutions,  but  each  is  a  Euclidean  transformation  of  any 
solution  obtained  by  arbitrarily  selecting  an  origin. 

When  the  data  are  fallible,  this  solution  is  no  longer 
reliable.  Selecting  different  objects  to  represent  the 
origin,  each  with  its  unique  error  of  measurement,  may  lead 
to  qualitatively,  as  well  as  quantitatively,  different 
representations  in  Euclidean  space.  In  particular,  they  are 
not  likely  to  be  linear  transformations  of  each  other.  A 
solution  to  this  problem,  posed  by  Torgerson,  is  to  choose 
the  centroid  of  the  objects  as  the  origin  of  the  Euclidean 
space . 

Torgerson’s  work  assumes,  however,  that  the  operations 
of  arithmetic  may  be  validly  applied  to  the  data  measured. 
For  this  reason,  the  procedure  is  called  a  'metric' 
algorithm.  The  field  of  multidimensional  scaling  was  expan¬ 
ded  to  include  nonmetric  procedures,  in  particular  those 


that  rely  on  ordinal  judynents  about  the  stimuli,  by  the  usf- 
of  a  scaling  transformation.  The  scaling  transformation  is 
estimated  as  a  monotone  function  of  the  gudgements,  so  to 
preserve  the  ordinal  characterist ics  of  the  data.  The 
crucial  aspect  of  the  transformation  is  the  estimation  of  a 
true  zero  on  the  scale  of  measurement  so  that  the  operations 
of  arithmetic  are  valid.  With  the  judgments  converted  to 
distance- like ,  or  sea lar -product -1 i ke ,  measures,  the  results 
of  Eckart  and  G.  Young,  and  G.  Young  and  Householder,  may 
be  applied,  and  a  Euclidean  space  of  low  dimensionality  may 
be  constructed  that  adequately  represents  the  objects  of 
interest. 

This  extension  of  multidimensicnal  scaling  was 
pioneered  by  Kruskal  and  Shepard  (Kruskal,  1964;  Shepard  and 
Kruskal,  1964;  Shepard,  1966).  An  additional  importunt 
contribution  to  this  area  is  due  to  Guttman  (Guttman,  196b)  . 

All  of  the  above  works  presuppose  a  single,  unified 
point  of  view.  If  data  are  collected  fiom  several  sources, 
the  individual  information  is  lost,  as  the  emphasis  is  on 
some  type  of  composite.  Attempts  to  isolate  an  underlying, 
common  point  of  view  yet  preserve  some  of  the  individual 
information  led  to  the  development  of  the  "individual 
differences"  model  of  multidimensional  scaling  (Tucket  and 
Hessick,  1963;  Bloxom,  1968;  Horan,  1969;  Caitoll  and  Chang, 


1970;  Schonenann,  1972;  Takane,  F.  H.  Young,  and  de  Leeuw, 
1977)  . 

As  in  the  previous  nodels,  a  set  of  points  in  a 
Euclidean  space  of  soae  dinension  is  deterained  using  a  com¬ 
posite  point  of  view.  In  addition,  a  set  of  weighting  fac¬ 
tors  are  estimated  for  each  individual.  These  weighting 
factors  alter  the  unit  of  measurement  alcng  each  of  the 
dimensions  of  the  common  Euclidean  space  according  to  the 
importance  of  that  dimension  as  perceived  by  the  individual. 
Some  of  the  individual  differences  models  allow  reflections 
of  the  dimensions  or  rotations  of  the  axes. 

An  algebraic  solution  to  the  individual  differences 

model  has  been  proposed  (Schonemann,  1972).  Although  the 

algebraic  solution  is  of  some  theoretical  significance,  its 

practical  application  is  limited,  again  because  of  the 

instability  problems  of  fallible  data.  In  the  above- 

mentioned  paper,  Schonemann  states: 

He  do  not  necessarily  recommend  its  use  in 
preference  over  presently  available  iterative 
algorithms.  Algebraic  solutions  sometimes  have  a 
tendency  to  become  unstable  in  the  fallible  case, 
and  it  is  therefore  often  safer  to  replace  them  in 
actual  applications  by  algorithms  which  have  well 
understood  optimality  properties... 

The  approach  in  this  paper  follows  the  above  suggestion  in 

that  an  iterative  solution,  not  an  algebraic  one,  is 


proposed . 


A  unified  theory  of  data  has  been  proposed  for  inul- 
tidimensional  scaling  by  F.  H.  Young,  et  alia  (  Young, 
1975;  de  Leeuvr,  Young,  and  Takane,  1976;  Young,  de  Leeuu, 
and  Takane,  1976a;  Young,  de  Leeuu,  and  Takane,  1976b; 
Takane,  Young,  and  de  Leeuw,  1977;  Young,  Takane,  and  de 
Leeuw,  1978).  The  development  of  multidimensional  scaling 
models  and  algorithms  had  been  unfocused,  but  the  theory  of 
data  developed  by  P.  W.  Young,  at  alia,  sets  a  structure 
in  which  the  various  models  fit.  The  next  section  presents 
this  theory  of  data  in  detail- 

Section  3.  The  ALSOS  Algorithm 

Young,  et  alia  (F.  H.  Young,  de  Leeuw,  and  Takane, 

1976a),  have  defined  optimal  scaling  as  fellows: 

Optimal  scaling  is  a  data  analysis  technique  which 
assigns  numerical  values  to  observation  categories 
in  a  way  which  maximizes  the  relation  between  the 
observations  and  the  data  analysis  model  while 
respecting  the  measurement  character  of  the  data. 

Scaling  techniques  other  than  that  proposed  by  F.  H. 

Young,  et  alia,  have  been  used  (e.g.,  Torgerson,  19Sz; 

Kruskal,  196U;  Guttman,  1968)  which  conform  to  this 

definition,  but  the  Alternating  Least  Squares  with  Optimal 

Scaling  (ALSOS)  is  the  most  coherently  stated  and  supported 

by  a  theory  of  data. 
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The  structure  of  the  ALSOS  algorithm  consists  of  a  data 
space,  an  optimal  scaling  space,  a  model  space,  and  a 
parameter  space.  The  data  space  and  the  optimal  scaling 
space  are  related  by  an  optimal  scaling  transformation.  The 
optimal  scaling  space  can  be  viewed  as  a  projection  of  the 
data  space  onto  a  numerical  space  restricted  by  the 
measurement  characteristics  of  the  data.  The  model  space  is 
a  least  squares  projection  of  the  optimal  scaling  space, 
subject  to  the  restrictions  imposed  by  the  model.  The  model 
space  and  the  parameter  space  are  related  by  a  combination 
rule,  or  formula,  which  defines  the  model. 

The  alternating  least  squares  algorithm  consists  of 
dividing  all  the  parameters  into  two  mutually  exclusive  and 
exhaustive  sets.  One  set  is  then  taken  to  be  fixed,  and  a 
solution  is  calculated  for  the  second  set.  This  solution  is 
then  taken  as  fixed  for  the  second  set,  and  a  solution  is 
calculated  for  the  first  set.  Hence  the  term  "conditional 
least  squares"  is  used  for  this  algorithm  (de  Leeuw,  Young, 
and  Takane,  1976),  as  the  least  squares  solution  at  each 
step  is  conditional  on  fixed  (possibly  unstable)  values  of 
the  other  parameters.  This  algorithm  has  also  been  called 
"block  relaxation"  (Cea  and  Glowinski,  1973;  de  Leeuw,  F. 
W.  Young,  and  Takane,  1976).  The  process  is  iterated  until 
convergence  criteria  are  satisfied. 
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In  the  optimal  scaling  phase  of  the  algorithm,  the 
observations  are  viewed  as  categorical  and  each  observation 
category  is  represented  by  a  parameter.  The  number  and  the 
nature  of  the  categories,  and  thus  the  parameters,  are 
determined  by  the  measurement  characteristics  of  the  data. 

These  are  discussed  more  fully  later  in  this  section. 

In  the  model  estimation  phase  of  the  algorithm,  the 
parameters  of  the  model  are  divided  into  mutually  exclusive 
and  exhaustive  sets  as  well.  A  Ic  ast -sgua;  >  m  lutior.  i  :> 
calculated  for  each  set  in  turn,  conditional  on  fixed  values 
for  the  other  sets  of  parameters.  The  overall  algorithm  f 

alternates  between  the  optimal  scaling  phase  and  the  model 
estimation  phase  until  convergence  criteria  are  met. 

Convergence  of  the  ALSOS  algorithm  has  been 
demonstrated  (de  Leeuw,  F-  W.  Young,  and  Takane,  1976;  de 
Leeuw,  undated).  It  must  be  noted,  though,  that  convergence 
is  guaranteed  only  to  a  solution,  not  necessarily  to  the 
globally  optimal  solution.  The  developers  of  the  algorithm, 
however,  appear  to  be  satisfied  that  the  globally  optimal 
solution  is  nearly  always  obtained  (de  Leeuw,  F.  w.  Young, 
and  Takane,  1976). 

The  applicability  of  the  algorithm  to  a  wide  range  of 
models  is  indicated  by  the  separation  of  the  optimal  scaling 

phase  and  the  model  estimation  phase.  In  f.ict,  F.  H.  I 
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Young,  et  alia  (F.  W.  Young,  de  Leeuw,  and  Takane,  1976a), 
have  stated: 

If  a  least  squares  method  is  known  for  analyzing 
quantitative  data  then  a  least  squares  method  can 
be  constructed  for  analyzing  qualitative  data. 

This,  then,  is  the  basis  for  applying  multidimensional  scal¬ 
ing  methods  to  the  problem  of  assessing  utilities  in  mul¬ 
tiple  dimensions.  In  order  to  support  this  application,  a 
closer  look  at  the  optimal  scaling  transformations  and  the 
measurement  characteristics  that  imply  them  is  needed. 

The  optimal  scaling  transformation  is  governed  by  the 
measurement  characteristics  of  the  data.  These  measurement 
characteristics  have  been  organized  into  a  theory  of  data  by 
F.  W.  Young,  et  alia  (F.  H.  Young,  de  Leeuv,  and  Takane, 
1976a, b),  described  in  terms  of  level  of  measurement  and 
process  of  measurement.  The  levels  of  measurement,  as 
described  previously,  are  binary,  nominal,  ordinal,  inter¬ 
val,  and  ratio.  The  latter  two  levels  are  often  combined  as 
numerical  data.  The  processes  of  measurement  are  discrete 
and  continuous. 

As  mentioned  above,  all  observations  are  interpreted  a.s 
categorical.  This  is  justified  in  the  sense  that  the 
procedure  by  which  observations  are  obtained  is  limited  by 
the  finite  precision  of  measurement  and  recording.  The 
level  of  measurement,  then,  is  concerned  with  the 


relationships  of  th*;  obsei  v  at  ions  anonj  the  cdtejories, 
wheroas  tl»e  pi  oi'os';,  ot  tneasui  em-'iit  is  cc  re  l  i  iied  with  th(.- 
reldtionships  within  the  c  at  t-'jori 

The  Mixiry  1  -  vt  i  -t  i.«  js  ui  •  Dit- t  ;  cs  t  a  1  a  1 1.  s  two 
i.:  a  t  ej  or  1 1'-, ,  i  ni:.-  t;.  'iy,  M.at  an  ' .  i  .  >_  i  v  a  t  i  o  r.  n-ithor  ha;'. 

c:ertain  ohai  i  '  .  .f  .  i  i.,.  !.,'t  .  In  the  nciri.'ial 

level  ot  a  ^  1  s  n  I  IT- •  a  t  ,  t  n>.  i  »•  oan  te  sevital  catejorifes,  hut 
the  only  i  *  ■ .  t  :  i  .  t  v  >  a  jev.ininj  ♦he  i  1  1 1  lo  ash  i  pn,  amon'j  the 
ratejori.o.  i  ti.at  rr.e  i  a  t  .-joi  n-f.  aie  net  equivalent.  In 
the  ordinal  lev.^l  at  o\.-i;meBerit,  the  cateyciies  arc  assumed 
to  be  ordered  in  ■■-ome  way,  but  there  are  nc  restrictions  on 
the  distances  t)et  ween  pairs  of  obsei  v  at  ions .  In  the  intet- 
vdl  level  of  meariurement,  the  optimally- scaled  value  is 
assumed  to  be  a  polynomial  function  cf  the  observaticti 
value,  including  an  opt i wa 1 1 y -scaled  origin.  In  the  ratio 
level  of  measurement  the  opt ima 1 1 y -sea  led  value  is  also 
assumed  to  be  a  polynomial  function  of  the  o  i-se  i  va  t  lori 
value,  but  the  origin  of  the  optimal  scaling  space  is 
assumed  to  be  the  same  as  that  for  the  observation  space. 

For  the  discrete  process  of  measurement,  the  optimal 
scaling  space  for  all  observations  within  a  category  is 
represented  by  one  number.  On  the  other  hand,  in  the 
continuous  process  of  measurement,  the  optimal  scaling  space 
witliin  a  category  is  represented  by  an  interval.  Thus,  tor 
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the  discrete  case,  observations  in  the  data  space  that  are 
Measured  to  be  equal,  or  that  are  equally  preferable,  are 
transformed  so  that  the  optimally-scaled  values  are  equal 
(i.e.,  ties  must  remain  tied).  In  the  continuous  case, 
observations  that  are  measured  to  be  equal  need  not  have 
equal  optimally-scaled  values;  however,  the  optimally-scaled 
values  of  all  observations  within  a  category  will  lie  in 
some  interval.  In  both  cases,  observations  that  are 
measured  not  equal  may,  or  may  not,  have  optimally-scaled 
values  that  are  equal,  or  not  equal. 

F.  W.  Young,  et  alia,  have  related  this  theory  of 
data  to  other  works.  The  d iscrete -nominal  case  had  been 
previously  developed  by  Fisher  (1946).  The  continuous- 
nominal  case  is  handled  by  a  two-phase  method,  the  first  a 
discrete-nominal  solution  and  the  second  a  continuous- 
ordinal  solution.  The  ordinal  cases  are  similar  to 
Kruskal's  two  approaches  (KrusKal,  1964).  The  discrete- 
ordinal  case  is  like  Kruskal's  secondary  approach,  whereas 
the  continuous-ordinal  case  is  like  his  primary  approach. 

The  discrete-interval  transformation  is  a  polynomial 
linear  regression  (linear  in  the  parameters).  The 
op t ima 1 1 y- sea  1 nd  values  are  polynomial  functions  of  the 
data.  In  the  continuous  case,  the  polynomial  regression  i.s 
followed  by  an  estimation  of  the  interval  boundaries,.  The 
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ratio  ca;',e:;  aie  the  r.ame  ai;  t  h*;  interval  case;.,  with  th« 
exception  that  the  regression  is  through  the  origin. 

Modelling  of  the  scaled  data  i;.  y  impoi  tan’’  ii. 

Young's  theory  of  data.  Various  l•lod(:ls  art  discus;;*-'!  in  t  h- 
next  section  in  exposition  of  multi  din:  e  dm  c  1. 1 1  scalirej  tech- 
nigues  in  aiultiattribute  utility  d5:s-' :  sac  !,t  and  in  the  ntxi 
chapter  in  detail. 

Section  4,  Some  Examples 

Some  of  the  models  of  oiu  1 1  id  ime,  ns  ic  i,  a  i  scaling  h.ive 
been  used  for  the  purpose  of  estimating  utilities.  Sene, 
such  as  the  additive  model,  have  straight-forward 
counterparts  in  the  utility  as.sessm t Jit  j.iterature.  Th*i:-f 
will  be  discussed  more  fully  in  the  next  c;hapter  on  conjoint 
measuremcint.  Others,  such  as  the  individual  differences, 
model,  do  not  hav*?  direct  analogies  in  thi*  utility  assess¬ 
ment  field,  hut  do  correspond  to  gener  al  izat  ions  of  model.- 
in  conjoint  measurement.  These,  too,  will  be  discur.sed  mot*, 
fully  in  the  next  chaptei.  The  puipcs.e  rf  this  .';*;<:tiori  i.-: 
to  reference  some  ex.imples  of  the  u.se  of  1 1,*  .-,e  model;;. 

The  additive  n'liloj  i t.he  - .  i  m  p  I  e;.  t  of  ties  mod*!:;.  It:; 
tlu’.M;;  i;.  t'liat  th.e  ('Vi-i.ill  utility  ;,tLu*:tui('  i;  f.'e'm ;  o:.*ii 
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solely  of  the  sum  of  the  utilities  along  the  dimensions  of 
the  data  space.  In  mathematical  terms,  the  model  may  be 
stated  as  follows: 

{III. 4.1)  u(x.,  )  =  u-,(x,)  +  (x-,)  +  .  .  ,  +  u  (x  ) 

12  n  il  22  n  n 

where  n  is  the  number  of  dimensions,  is  a  value  along  the 
ith  dimension,  and  u^(x^)  is  the  utility  at  value  along 
the  ith  dimension. 

This  model  has  been  used  extensively  in  the  literature 
(e.g.,  Kruskal,  1965;  Green  and  Hind,  1973;  de  Leeuw,  F.  H. 
Young,  and  Takane,  1976;  Keeney  and  Raiffa,  1976;  Humphreys 
and  Wisudha,  1979).  The  model  is  analogous  to  the  main- 
effects  analysis  of  variance,  assuming  that  the  interaction 
terms  are  all  zero.  The  difficulty  with  the  model  is  its 
assuffl-^ions  about  additivity.  It  presupposes  that  the 
utility  structures  along  parallel  lines  through  the  data 
space  (e.g.,  parallel  to  the  axis  of  one  dimension)  are  sim¬ 
ply  translations  of  each  other.  This  is  a  strong  assumption 
to  ma)te  and  it  should  be  tested  carefully. 

A  second  model  commonly  purported  is  the  individual 


differences 

model 

(e.g..  Tucker 

and  Messick, 

1963;  Bloxom, 

1968; 

Horan , 

1969; 

Carroll  and 

Chang , 

1970 

;  Schonemann, 

1972; 

Green 

and 

Hind,  1973;  Takane,  F. 

H. 

Young,  and  de 

Leeuw,  1977).  In  this  model,  we  are  presupposing  that  the 


data  are  collected  from  several,  not  necessarily  comparable 
sources  and  we  are  estimating  a  Euclidean  subspace  which 
represents  a  common  point  of  view.  Be  also  estimate 
individual  weights  for  the  dimensions  of  the  Euclidean  space 
which  represent  the  importances  of  the  dimensions  as  per¬ 
ceived  by  the  individuals.  As  a  mathematical  model,  it  can 
be  represented  as  follows: 

(III. 4. 2)  -  X'W^X 

where  is  a  matrix  of  scaled  data  for  individual  i,  X  is  a 
matrix  of  coordinates  in  some  Euclidean  space  for  the  set  of 
stimuli,  and  is  a  matrix  of  weights  for  individual  i.  In 
some  models,  is  constrained  to  be  diac:nal  so  that  the 
model  allows  only  differences  of  perception  along  the  axes 
of  the  common  space  represented  by  the  matrix  X.  In  other 
formulations,  the  matrix  may  be  a  general  orthogonal 
matrix  so  that  the  individual  differences  may  be  manifested 
as  rotations  of  the  set  of  axes  of  the  common  space. 

For  examples  of  the  use  of  individual  differences 
models  in  utility  assessment  situations,  see  Green  and  wind 
(1973)  . 


Ch^ter  I?.  COtlJOIHT  HEASDBEHEMT 


Section  1.  Introduction 

The  field  of  conjoint  measurement  is  concerned  with  the 
foundations  of  measurement.  Assuming  only  the  existence  of 
sets  of  objects  and  basic  relationships  among  them,  the 
existence  and  uniqueness  of  numerical  scales  may  be 
established.  Several  axiomatizations  have  been  presented  in 
the  literature  that  result  in  different  structures  involving 
multiple  dimensions. 

Conjoint  measurement  is  closely  related  both  to  mul¬ 
tidimensional  scaling  and  to  utility  estimation.  It  has 
been  claimed  that  multidimensional  scaling  is  a  special  case 
of  conjoint  measurement  (Tversky,  1967a;  F.  W.  Young, 
1972).  It  can  also  be  seen  that  utility  estimation,  in 
various  formulations,  is  a  special  case  of  conjoint 
measurement  (Tversky,  1967a;  F-  W.  Young,  1972;  Krantz, 
Luce,  Suppes,  and  Tversky,  1972) .  One  of  the  goals  of  this 
paper  is  to  present  utility  estimation  in  a  general  formula¬ 
tion  of  conjoint  measurement. 
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The  field  of  conjoint  aeasurement  is  also  relevant  to 
this  paper  for  its  model  formulations.  The  tuo  most  nidely 
used  models  for  multiple-attribute  utility  functions,  the 
additive  and  the  multiplicative  models,  have  been 
extensively  investigated  in  the  literature  (Krantz,  Luce, 
Suppes,  and  Tversky,  1972;  Keeney  and  Paiffa,  1976).  The 
additive  model  presupposes  that  a  multiple-attribute  utility 
function  is  a  (possibly  weighted)  sum  of  the  single¬ 
attribute  utility  functions  of  its  components.  The  mul¬ 
tiplicative  model  presupposes  that  a  multiple-attribute 
utility  function  is  a  product  of  the  single-attribute 
utility  functions  of  its  components. 

In  Section  2,  the  additive  and  multiplicative  models 
are  discussed.  An  axiomatization  of  measurement  for  each 
model  is  briefly  presented.  It  must  be  realized  that  other 
axiomatizations  leading  to  the  same  model  are  possible,  and 
that  the  axiomatizations  selected  are  for  illustrative 
purposes  and  not  particularly  for  comparison.  Some 
implementations  of  these  two  models  are  also  referenced  and 
the  disadvantages  of  the  models  are  outlined. 

In  Section  3,  two  more  general  theories  of  conjoint 
measurement  are  discussed  (Tversky,  1967a;  K.  W.  Young, 
1972).  Both  are  concerned  primarily  with  polynomial  con¬ 
joint  measurement,  i.e.,  the  model  of  a  multiple-attribute 
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utility  function  is  a  general  polynonial  function  of  the 
utility  functions  of  its  components.  The  second  theory, 
unlike  the  first,  is  not  an  axiomatization ,  although  it  is 
more  general  in  that  it  allovs  more  general  functions  for 
models  than  polynomials.  The  additive  and  the  mul¬ 
tiplicative  models  are  special  cases  cf  these  theories.  The 
utility  assessment  procedure  of  Novick  and  Lindley  (1979)  is 
also  related  to  the  formulation  of  Young,  thus  establishing 
the  connection  with  a  concrete  example  and  providing  the 
motivation  for  the  development  that  follows  in  the  next 
chapter . 

Section  2.  additive  and  Multiplicative  Models 

In  this  section,  two  axiomatizaticns  of  conjoint 
measurement  are  presented.  The  first  is  an  axiomatization 
of  additive  conjoint  measurement  (Luce  and  Tukey,  1964). 
The  second  is  an  axiomatization  of  multiplicative  conjoint 
measurement  (Roskies,  1965)  . 

In  the  additive  axiomatization,  the  tesulting 
representation  of  the  measurement  scale  ot  a  multiple- 
attribute  consequence  set  is  a  sum  of  measurement  scale;-  of 
^  hf  individual  attribute;-..  ex.impl*,  lit  F- ,  K 

di;;  joint  sets  of  con;;f;iju<  rici;; ;  tieti,  i‘  thi-  iin  i 


space  of  interest  is  a  subset  of  the  product  space 

AxBx. . .xK, 

u(a,bi...,k)  =  u(a)  +  u  iu)  ^  a... 

J\  H 

The  axiomatiza tions  leading  to  this  c e presen t a t i on  are 
presented  in  Table  17.2.1.  This  is  the  original 
axiomatization ;  there  have  been  several  extensions  that  are 
not  presented  here  (Krantz,  1964;  Luce,  1966a;  Krantz,  Luce, 
Suppes,  and  Tversky,  1972) .  Some  of  these  extensions 
provide  for  the  k-dimensional  representation  illustrated 
above.  Other  extensions  generalize  the  notation.  The 
characterization  is  essentially  the  same. 

The  key  axiom  to  the  additive  representation  is  Axiom 
3,  the  Cancellation  Axiom.  It  is  best  illustrated  in  the 
following  three  by  three  table  : 


P 

X 

A 

(A,P) 

(A,X) 

(A,y) 

F 

(F.P) 

(F,X) 

(F,Q) 

B 

(B,P) 

(B,X) 

(E,Q) 

The  axiom  assumes  that  the  orderings  along  the  diagonals, 
from  the  upper-left-hand  corner  to  the  lower-r ight -hand  cor¬ 
ner,  are  consistent. 


This  is  a  strong  assumption  to  make,  and  it  leads  to  a 
strong  representation.  In  the  additive  model,  the  contiit)u- 
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Table  II.2.J 

The  Luce-Tukey  Axionati2atioD 
(Luce  and  Tukey  1964) 

Let  A  be  a  set  with  typical  elements  A,  E,  C,  F,  G,  K, 

...  and  P  a  set  with  typical  elements  P,  Q,  R,  ...»  X,  Y, 
Z;  then  A  X  P consists  of  pairs  (A,P) ,  (A,Q),  (B,Q),  etc.  Let 

>  be  a  binary  relation  on  such  pairs.  (Thus  >  is  equivalent 
to  a  subset  of  (Ax P)  x  (AxP) ) - 

(VA)  Ordering  Axiom  (Axiom  1).  >  is  a  weak  ordering,  i.e., 

(VB,  Reflexivity)  (A,P)  >  (A,P)  holds  for  all  A  in  A  and  P 
in  P  ; 

(VC,  Transitivity)  (A,P)  >  (B,Q)  and  (E,Q)  >  (C,R)  imply 

(A,P)  >  (C,R)  ; 

(VD,  Connectedness)  Either  (A,P)  >  (E,Q)  cr  (B,Q)  >  (A,P), 

or  both. 

(VE)  Definition.  For  A,  B  in  A  and  P,  Q  in  P,  (A,P)  = 
(B,Q)  if  and  only  if  (A,P)  >  (E,Q)  and  (B,Q)  >  (A,P); 

(A,P)  >  (B,Q)  if  and  only  if  (A,P)  >  (B,Q)  and 

not(  (B,Q)  >  (A,P)  )  . 

(VP)  Solution  (of  Equations)  Axiom  (Axiom  2).  For  each  A 
in  A  and  P,  Q  in  '  ,  the  equation  (F,P)  =  (A,0)  has  .i 
solution  F  in  and  for  each  A,  E  in  A  and  P  in  P  , 
the  equation  (A,X)  =  (B,P)  has  a  solution  X  in  P. 
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Table  IJf.2.1 
(continued) 


(VG)  Cancellation  Axiom  (Axiom  3).  For  A,  F,  B  in  A  and  P, 
X,  Q  in  P ,  (A,X)  >  (F,Q)  and  (F,P)  >  (B,X)  imply  (A,P) 


>  (B,Q)  . 

(VIA)  Characterization.  A  doubly  infinite  series  of  pairs 
{A^,Pi),  i=0,l1,  *2,  with  A^  in  A  and  P^  in  P,  is 

a  dual  standard  sequence  provided  that 


(?IB)  (A^,P^)  =  (Ap,P^)  whenever  m*n  =  p*q  for  positive,  zero, 

or  negative  integers  m,  n,  p,  and  g.  A  dual  standard 


sequence  is  trivial  if  for  all  i  either  =*q  ot 
P. =P„ ,  in  which  case  both  hold  by  transfer. 

(VIC)  Archimedean  Axiom  (Axiom  4).  If  {A^,P^)  is  a  non¬ 
trivial  dual  standard  sequence,  B  is  in  A  and  Q  is  in 
P  ,  then  there  exist  (positive  or  negative)  integers  n 

and  m  such  that  (A  ,P  )  >  (B,Q)  >  (A  ,P  ) . 

n  n  -  '  -  m  m' 


*  cr  V.  i.  <c  L  d  t  -  L'  1  ^  v»  .  C  ^  k: 

and  T  u  k  e  y  fi  a  v  e  t  a  1 1  a  '  i  • .  <  •  ; 

More  generally,  a  question  raised  throughout  the 
social  and  behavioral  sciences  is  whether  two 
independent  variables  contribute  independently  to 
an  overall  effect  or  response.  The  usual  approach 
is  to  attach  to  each  pair  of  values  of  the 
variables  a  numerical  measure  of  effect  that 
preserves  the  order  of  effects  and  then  to  test 
for  independence  using  an  additive  statistical 
model,  probably  one  of  the  conventional  analysis 
of  variance  models.  When  dependence  (interaction) 
is  shown  to  exist,  one  is  uncertain  whether  the 
dependence  is  real  or  whether  another  measure 
would  have  shown  a  different  result.  Certain 
familiar  transformations  are  often  applied  in  an 
effort  to  reduce  the  danger  of  the  second  pos¬ 
sibility,  but  they  are  unlikely  to  approach 
exhausting  the  infinite  family  of  acnctcnic  trans¬ 
formations,  so  that  one  cannot  be  too  sure  of  the 
reality  of  an  apparent  interaction.  Our  results 
show  that  additive  independence  exists  provided 
that  our  axioms  are  satisfied;  of  these,  the  most 
essential  one  from  a  substantive  point  of  view  is 
the  cancellation  axiom,  which  is  also  a  necessary 
condition  for  an  additive  representation  to  exist. 

Thus,  one  could  test  the  cancellation  axiom  by 
examining  a  sufficiently  voluminous  body  of 
ordinal  data  directly,  without  introducing  any 
numerical  measures  and,  thereby,  test  the  primary 
ingredient  in  additive  independence.  In  some 
applications  this  should  be  mote  convincing  than 
present  techniques. 

Comments  about  the  adequacy  of  the  additive  representation 
in  general  situation;:,  are  presented  later  in  this  section. 
Suffice  it  to  mention  here  that  the  assumption  of  additivity 
is  not  one  lightly  accepted,  and  one  needs  alternatives  for 
those  situations  when  the  additive  representation  is  not 
appropriate  because  of  the  violation  of  one  or  more  of  the 


axioms . 


Closely  related  to  the  additive  re[:  resentat  ion  is  the 
multiplicative  representation.  The  axioms  ot  the  Koskies 
system  (Roskies,  1965)  are  listed  in  Table  IV. 2. 2.  There  is 
a  clear  analogy  between  the  Luce-Tukty  system  and  th#- 
Roskies  system.  Axioms  1  through  .3  of  each  system  servo 
analogous  purposes.  Axiom  6  of  the  Roskies  system  is  stated 
to  be  the  same  as  Axiom  4  of  the  Luce-Tukey  system.  The 
major  difference  are  the  axioms  in  the  Roskies  system  to 
establish  the  idea  of  zero. 

The  representation  implied  by  the  Rcskies  axiomatiza- 
tion  is  a  multiplicative  one,  as  follows: 

(IV.  2. 2)  1  ^  ku(A,  X  A.,  X...X  A,,  'itk  k.i.'A  /  . 

‘2  K  .  ;  1 

Note  that  this  may  be  converted  to  an  additive  representa¬ 
tion  by  the  use  of  the  log  transformation  and  the  realiza¬ 
tion  that  the  scales  u,  u^  ,  ...,  u  are  uniqu<.'  only  up.  to  a 
positive  linear  transformation. 

These  two  representations,  the  additive  model  and  the 
m  u  1 1  ip  1  ica  t  i  V .  inodt'l,  are  prominent  in  the.  fi>'ld  <jf  conjoint 
measurement  and  in  the  field  of  utility  a  s^  m*  n  t  . 
bpeerfre  xamples  may  be  found  in  fishhurn  (19bt.),  Poliak 
(I'lhV),  Or  ocn  ai.d  Wind  (197  1),  Keeney  and  h  ich  e-i  ma  ii  (1975), 
Keeney  and  Raiffa  (19/h),  and  Humphrey.';  atid  Wi.sudl.i  (  1979), 
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Table  19.2.2 

The  Roskies  Axiomatiz ation 
(Roskies  1965) 

Let  A  be  a  set  with  elements  A,  E,  C,  F,  G,  ...  and 

let  '”bea  set  with  elements  P,  Q,  R,  X,  Y,  ....  -x 

consists  of  pairs  (A,P),  (B,P),  (C,X),  etc. 

Axiom  1.  Ordering.  Let  >  be  a  binary  relation  on  x  such 
that  >  is  a  weak  ordering;  that  is,  fci  all  A,  E  in 
and  P,  Q  in  r, 

(a)  (A,P)  >  (A,P)  ; 

(b)  if  (A,P)  >  (6,(3)  and  (E,C)  >  (C,F)  then  (A,P)  > 
(C,R)  ; 

(c)  either  (A,P)  >  (B,C)  or  (B,C)  >  (A,P). 

Definition.  (A,P)  =  (B,Q)  if  and  only  if  (A.P)  >  (B,0)  and 

(B,Q)  >  (A,P);  (A,P)  >  (B,0)  if  and  only  it  not((F,i.)  > 

(A,P)  )  . 

Definition.  Since  the  ordering  >  is  weak,  it  (aititmiis  '  x 
into  equivalence  classes  defined  by  =.  From  now  on,  wi 
work  with  the  equivalence  classes,  which  we  continue  to 


denote  by  ( A , P)  . 
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Table  :V.z.2 
(conti  iMU'-il) 
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Table  IV. 2. 2 
(continued) 

Axiom  5.  Let  A,  B  be  not  in  i  ,  P,  C  not  in  . 

,  1  p 

If  PsQ  and  (A,P)  >  (B,P)  then  (A,C)  >  (B,Q); 

if  P-sQ  and  (A,P)  >  (D,P)  then  (A,Q)  <  {B,Q): 
if  AsB  and  (A,P)  >  (A,(J)  then  (fi,  P)  >  (E,Q); 

if  A-sB  and  (A,P)  >  (A,g)  then  (E,P)  <  (B,Q). 

Axiom  6.  The  Archimedean  property  as  defined  by  Axiom  4  cf 
the  Luce-Tukey  system  holds  on  (  ./x;*). 


aaony  others. 


Section  3.  Polynomial  Conjoint  Beasurecent 

In  this  section,  two  .ji-ntral  thecrie.''.  of 
muasureoient  ar«  disc  us  sea.  ('i;  e  li-  a  ['siyncsial  i  ept' ';Sc  r;t  a -- 
t ion  a X iomat i ea t ion  (Tversky,  f9o7a).  The  other  (T. 

ioung,  1972)  is  not  an  a x i o aa t i za t io n ,  and  is  not  restricted 
to  polynomial  representations,  hut  is  a  prose  n  t  at  i  oii  of  a 
'jeneral  theory  of  conjoint  ctasute  ment  mcJels. 

The  ax loma tization  by  Tversky  is  presented  here  foi 
completeness  of  background  material.  The  axiom  a  tization  is, 
not  iiscusi;ed  in  detail,  but  is  merely  prestr.ttd  as 
theoretical  support  ret  the  rep  rose  r.  t  1 1  i  c ,  or  acdi'.l,  tiiai 
is  the  subject  ot  this  paper.  The  paper  by  Young  is 
presented  to  provide  justification  for  the  model  develop t  d 
in  the  next  chapter. 
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polynomial  mea.suretnent  model;  that  is,  any  model 
where  each,  data  element  is  expressed  a  a  specified 
real-valued,  order-preserving  polynomial  function 
of  its  components. 

The  first  respect  is  important  because  it  allows  two  data 
elements  to  be  uncomparable.  In  previous  ax  io  ma  ti  zat  i  cn.s  , 
it  was  necfssary  that  for  every  two  data  elements  one  be  at 
leas^"  as  prefer*. ble  as  the  other.  In  the  applications 
con.eic^ered  i ;;  this  pap'cr,  utility  asse-SsEent,  it  may  le  that 
two  data  elements  may  not  he  comparable  because  of  the 
unlikelihood  or  the  incomprehensiblene  s.s  of  ctie  or  the  other 
of  the  .situations  that  the  data  .ileniGnts  i  ej  I'esc-nt.  .  Thi.e 
generalization  allows  us  to  ignore  such  a  prolleii. 

The  second  respect  provides  a  theoretical  justification 
for  the  level s-of-measuren'ent  data  structuring  used  by  F. 
w.  Young,  t-t  alia,  as  pre.sented  in  the  previous  chapter, 
and  adapted  in  this  paper.  Although  the  proofs  of  t he 
representation  provided  by  Tversky  are  not  directly 
applicable  to  all  t)io  data  structures  described  hy  Young,  in 
p.irtii'ular  thr*  nominal  lev(  1  of  raeas  u  r  e  m  e  n  t  ,  they  do  apply 
fo  mo.st  of  the  situation;:,  and  the  general  structure  of  r  tu. 
rhoory  appear.';  to  fit  in  all  ca;;es. 

The  third  •■••;,-poct  is  inij'ortant  Iccan-e  it  generalizes 
the'  solvability  axir'm.s,  which  we-re  crucial  in  the  previous 
X  iom  a  t  i  z  a  t  1  on  .s  .  In  th-*  Luce-Tuke’y  and  in  the;  Hrvikif.s 
syste'nis,  it  is  n  < -c  o  5.  s  a  r  y  tliat  the  data  .'i  1 1  u<' t  u  r  fs;  he  dens< 
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enough  lio  that  solutions  to  oquiv.ilence  Lolation-S  ( 
in  all  cases.  The  formulations  of  the  solvability 
required  that  the  data  structure  be  infinite.  The 
generalization  relaxes  this  restriction,  allowing 
flexibility  in  application. 


)  e  X  _ ;  t 

a  X  i  o  m  -s 


Tver ;  >  h  y 


g  r  e  a  t  fe  r 


The  previous  axicraatizations  did  net  directly  address 
the  question  of  necessity  and  sufficiency,  and  therefore 
should  be  considered  to  represent  sufficient  conditions 
only.  The  Tvorsky  theory  does  address  this  question. 

The  fifth  respect  allows  Jess  restrictive  nodels  than 
the  previous  representations.  If  x  =  (a,h,...,k)  is  a  data 
element  in  /',xBx...xK  where  a  is  in  A,  t  is  in  B,  ...,  k  is 
in  K ;  1,  m ,  ...,  n  are  integers;  then  the  representation  can 
be  displayed  as 


{IV.  3.1)  ;  .  ::  i  *  .  .  .  * 

where  the  summation  is  over  some  subset  cf  all  combinations 

of  1,  in,  ...,  n.  Formally,  Tversky  states: 

A  data  iitructure  D  =  <  >c  >  is  a  system  wher*; 
is  a  subset  of  the  product  set  AxEx...xK  of  some 
finite  number  of  liis  joint  sets  A,  B ,  ....  K,  and 
is  partially  ordered  uniler  >o.  That  is,  >o  is  a 
binary  relation  defined  on  :  which  satisfies  ttie 
following  conditions  for  all  x,  y,  z  in  ,  : 

( i )  IM  f  1  e  X  i  V  i  t  y  ,  x  >  o  x  ; 

(li)  Transitivity,  x  >o  y  and  y  >c  z  imply  x 
>0  z  ; 

X  -o  y  is  defined  as  x  >o  y  and  y  >c  x;  x  >n  y  j  ■. 
defined  as  X  >o  y  and  not  y  >o  x. 
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A  data  structure  D  is  said  to  satisfy  a  polynomial 
measurement  model  M  whenever  there  exists  a  real¬ 
valued  function  f  defined  on  D  and  real-valued 
functions  f^  ,  f^  ,  f^  defined  on  factors  A,  E, 

K  such^  that,  for  any  data  element 

(a, b,  .  .  . ,  k)  : 

(i)  f(a,b . k)  =•  (a)  ,1  jj(b)  ,  .  .  .  ,  tj.(k)) 

where  M  is  a  polynomial  function  of  its  arguments, 
that  is,  a  specified  combination  of  sums, 
differences,  and  products  of  the  functions  f.  ,  , 

•  •  •  #  ^  K  * 

(li)  for  all  X  =  (a,b,.-.,k),  x'  = 

(a',b’ . k')  ,  X  >o  x'  implies  f  (x)  >  f(x')  and  x 

=o  X’  implies  f  (x)  =  f(x')  where  >o  and  -o  denote 

the  order  observed  in  the  data. 

Tversky  notes  that  the  general  polynomial  conjoint 
measurement  model  encompasses  a  wide  variety  of  well-known 
measurement  models.  Included  as  examples  are  Hull's  and 
Spence's  performance  models  as  cited  in  Kilgard  (1956),  the 
Bradley-Ter r y-Luce  choice  model  (Luce,  1959),  the  mul¬ 
tidimensional  scaling  models,  and  Savage's  subjective  expec¬ 
ted  utility  model  (Savage,  1954)  . 


Although  not  an  a xiomatizat ion ,  and  thus  not  as 
strongly  placed  on  theoretical  measurement  foundations,  is 
the  generalization  of  conjoint  measurement  offered  by  Yeung 


(F- 

W .  Young,  1972).  Young 

presen  t  s 

a  general 

functional 

f  or  m , 

(IY.3 

.2)  b(v)  :  h,  ..h  ,ix^ 

'  ,  ^  1  , 

-  1  ,  1 

1  . . ' 

where 

the.  notation  x  i.s  used 

i . 

to  denote 

the  i  t  li  I 

uw  of  X , 

and  X 

is  a  matrix  of  coordinate 

s  used  to 

sp.,t  ial  ly 

represent 

a  set 

of  objects. 
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Youny  then  shows  liow  various  models  presented  in  the 
literature  can  be  represented  by  this  general  functional 
form.  Included  are  the  Zuclidean  and  .rinkowsKi  distance 
.scaling  (Kruskal,  1964;  Shepard,  1966;  Guttflian,  l'!6b},  mul¬ 
tidimensional  unfolding  (Coombs,  1964)  ana  a  y  eiie  r  a  1  x /,  a  1 1  on 
to  Minkowski  metrics,  mcnotcne  analysis  of  variaiic*.- 
(Kruskal,  1965)  which  is  related  to  the  additive  conjoint 
measurement  model  (Luce  and  Tukey,  1964),  polynomial  con¬ 
joint  measurement  (Tver sky,  1967a),  non-metric  factor 
analysis  (Shep'ard,  1966;  Lingoes  and  Guttman,  19b7;  Kruskal 
and  Shepard,  1974),  subjective  expected  utility  (.Savage, 
1954) ,  and  the  Bradley-Terry-Luce  choice  model  (Luce,  1959) . 

using  Tversky's  theory,  being  applicable  to  numerical 
data  as  well  as  ordinal  data,  it  is  easy  tc  see  that  Young's 
rorinulation  applies  equally  well  to  metric  factor  analysis 
(Libby,  1979),  principle  components  analysis  (Young,  Takane, 
and  de  Leeuw,  1978),  regression  analysis  (Young,  de  Leeuw, 
and  Takane,  1976b),  analysis  of  variance  (Kruskal,  1964;  de 
Leeuw,  Young,  and  Takane,  1976),  and  analysis  of  covariance 
structures  (Libby,  1979) . 

We  can  also  formulate  the  model  of  utilities  used  by 
Novick  and  Liiidley  (1979)  using  Young's  theory,  in  tlio  sum.' 
a.iy  that  Tver  sky  and  Young  formulate  similar  raodel.s. 
Although  not  s. trictly  a  polynomial  model,  the  m.itrix  of 


indifference  probabilities  can  be  likened  to  Youny's  matrix 
of  similarities  which  is  fitted  by  a  function,  in  this  case 
the  ratio  of  certain  differences,  of  the  utilities. 


There  are  two  relevant  conclusions  in  the  paper  by 
Tversky.  The  first  is 

The  generality  of  the  present  theory,  however, 
steins  not  only  from  the  fact  that  most  measurement 
models  proposed  can  be  represented  as  polynomial 
functions  but  also  from  the  well-known  result  that 
any  continuous  real-valued  function  on  a  closed 
bounded  region  can  be  uniformly  approximated 
arbitrarily  closely  by  a  polynomial  function. 

This  certainly  applies  to  the  applications  of  interest  for 

this  paper,  namely  utility  assessment.  The  second 

conclusion  is 

The  present  theory,  however,  does  not  provide  any 
simple  set  of  empirically  testable  conditions 
which  can  be  easily  interpreted  as  a  substantive 
theory.  Furthermore,  the  general  theory  does  not 
provide  any  constructive  procedure  for  obtaining 
the  desired  numerical  representation. 

In  fact,  because  of  the  difficulties,  testable  condition^; 

have  only  been  developed  for  simple  models  (Krantz,  Luce, 

Suppes,  and  Tversky,  1972;  Fishburn,  1973).  Tversky  (l^n/a) 

also  leaves  open  the  problem  of  "the  development  of 

appropriate  error  theories  together  with  a  statistical 

analysis  of  the  problems  of  goodness -of  -  f  it  of  tlio*  data  to 


models.  " 


Some  of  these  [iroblems  will  be  addresr.ed  in  the  next 
ciiapter,  relative  to  a  s.pecific  model  <jpilied  to  tl:e  assts:.- 


oent  of  utilities  in  a  mul t ipl e -a t t r ib u te  space. 
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chapter  ?.  POLYIOMIAL  OTILITY  ASSESSWENT 


Section  1.  Introduction 

In  this  chapter,  ue  outline  how  the  theories  and 
methods  of  multidimensional  scaling  and  conjoint  measurement 
may  be  employed  to  obtain  one  extension  of  the  uniattribute 
utility  assessment  procedure  of  Novick  and  I.indley  to  mul¬ 
tiple  attributes.  The  process  is  straight-forward,  and 
therefore  it  is  not  be  discussed  in  great  detail.  Some  of 
the  interpretations  of  the  resulting  representation  are 
interesting,  however,  and  are  reviewed. 

In  Section  2,  the  Novick  and  Lindley  procedure  is 
represented  as  a  general  conjoint  measurement  model,  as 
formulated  by  F.  W.  Young  (  1972).  It  is  then  .shown  tliat 
thi.s  representation  can  be  extended  to  multiple  attiibuti:, 
in  a  straight-forward  manner.  Tlie  resulting  t  i.'pr  esen  t  a  t  i  on 
is  a  general,  fixed-state,  discrete,  m u 1 t i a t t r i bu t e  utility 
function. 

This  model  requires  that  utilities  lie  infeiied  foi 
every  point  in  the  multiattribute  space  that  is  used  in  the 
elicitation  procedure.  In  h  i  gh- d  i  me  ns.  i  c  na  1  [tiobleras,  this 


involves  many  paLatnetets ;  therefcjre,  the  pclynoioial  coii]oii.t 
measurement  theory  ir.  invoked  to  pioviiU/  a  mcLe  pa  i  i  mor.  x :  n;, 
representation.  In  particular,  Ivick  at  a  :  o  j  i  r  h  -  leji 
polynomial  of  the  uniattrihute  scale  represent  at i on .  it 
should  be  remembered,  how>-ver,  that  thei^.  i:  lio  jotd  iu.ai,uit- 
ot  the  adequacy  ol  the  i  e  {  r  ese  n  t  a  t  ion  nor  n,  ttu'ie  a  theory 
of  error  of  measurement  lot  the  jenc-rai  par  1  y  iiom  r  a  ^ 
representation.  These  issues  ate  discussed  in  Section  J. 

Ey  luvokin. q  techniques  from  multidimensional  scilinq, 
we  can  relieve  some  of  the  difficulties,  that  led  Novick  and 
Lindley  to  infer  utilities  in  the  logodds  metric.  We  sug¬ 
gest  that  the  elicited  ind i  f  f ereiic  e*  p  t  cliabi  1  it  ies  may  tx/ 
scaled  before  fitting  the  polynomial  model  of  the  utilities. 

We  al;;o  address  the  problem  of  the  relationship  between 
the  model  s.  ^jace  (e.g.,  the  resulting  uni  at  tribute  ;;cales  in 
the  polynomial  r  epr  e.sent  a  i  ion)  and  t  tie  undi'ilying  ohiect 
space.  In  paiticrulai,  we  s.uggtst  that  a  .  ysteo  ol  tourth- 
degree  polynomial  functions  may  he-  lit  to  the  distoition 
between  the  tuo  spaces  wlien  ttie  underlying  o(,-)ert  .si  aCe-  i.s 
as, suraed  to  tic  a  suhset  of  tt'i-  picduct  ;,;,ire  el  i '-a  ]  n  u  ai  t)f?r.',  . 
The  work.s  of  other  auttiors  alonj  these  ?.am(.  lint  .s  i;;  cited. 
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Section  2.  The  Extended  HovicK-Lindle y  Procedure 


Recalling  the  development  of  the  Ncvick  and 
fixed-state  utility  assessment  procedure  from  Chaptei 
basic  model  may  be  represented  as 


(V.2.  1) 


I 


where  p,  is  the  probability  that  equates  utility  u 
gamble  involving  two  .states  with  utilities  u  and  , 
a.nq  that  u,  >u  >u  .  This  will  now  be  tela  ted  to  tlu/ 

.K.  ' 

conjoint  measurement  model  of  F.  W,  Young  (1972). 
however,  it  mu.st  be  noted  that  we  are  ccncorneti  he 
tiiree  variables  (i,  j,  and  Ir)  wliereas  Ycuiig':.  tor  mu 
using  con  ven  t  ion<\  1  matrix  notation,  wa:.  ccnce-rio-d  wi 
two  variable;;.  Ttii;;  po;;er.  no  real  problem  ar.d  t;o  i 
any  one  of  .‘ever. si  way.';.  The  eas-iest,  peihai).>, 
conceive  of  k  index  :i!;  the  froluwns  of  Young';;  mat  r  in 
and  j  together  indexing  the  row;;. 
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We  can  thcLeforc-  (letive  a  conveiiient  co  r  r  c-.s  po  n  de  n  ce 
between  tlie  two  mode]:;,  i  ec.i  1 1 1  n  .j  Young':,  gn'ii.-Lii  3iod(.]: 

(V  .  2.  2)  h  .  h  ,  n  ,  :  x  '  . ' 

by  letting  X  be  tlie  matiix  of  inferre-!  util^tiex  (a  column 
vector),  j)  and  j'-k,  h  be  an  identity  function,  and 

(V  .  2.  3)  ii.  (  u  .  ,  ,  1.  ,  ,  j 

i.  .  1 

Now  it  must  be  noted  that  in  the  above  formulation,  u  , 
u^,  and  u  are  used  to  denote  function  values,  in  particular 
u(),  u('),  and  u{,),  respectively,  where  ,  ,  and 

I  ;  r.  i 

are  points,  or  object:;,  in  the  underlying  u n  i a  1 1  r  i b u  t  o 
■spiice.  The  jeiit*r  a  liz  a  t  i  on  to  multiple  .ittribut>-:  i:;  now 

clear.  If  we  let  _  ,  _  ,  and  _  he  point  ;  in  a  mul- 
t  idimensional  space  an  ’,  u  (_  )  he  a  functicn  fiom  the  mul- 
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,  of  wnach  _  is  a 

■J  e  n  r  i  c 

o  i  ft  1? '  ^  n  t ,  iut  o 

the  real 

number:;,  t  h  < 

'n  t  lie  above  modtl 

(V-2.  I) 

qivt.-s  U'.i  a 

utility  function  ovei  a  m  u  1 1  id  imeiis  ion  a  ]  cutccuDo  space. 

Some  of  the  i  m  {■  1  ica  1 1  oiu;  of  this  mod:  1  ,';hould  In- 

[loitited  out.  Ill  St,  the  jamt;l‘o;  that  ai*  u:,ed  in  t  h> 

el  icit.lt  ion  i' L  oc  ed  u  i  <  • ,  which  i  r;  exactly  the  s.imi  a., 

advocated  by  Novick  and  I.indley  .iii'l  m  j  1  e  a  r  u  t  e  d  1.  y  hovicK, 

(-t  alia  (Is.iac:.  an!  Novick,  1't/b;  N'-vick,  I.itby, 


Chen,  and  Woodworth,  1980),  involves  each  foint  in  the 
underlying  space  witliout  regard  tc  structure  other  than 
order  in  the  utility  metric.  Ue  make  the  same  assumption 
that  the  multiple  attribute  utility  function  is  a 
monctonically  increasing  function  of  the  undtrlyimj 
dimensions.  The  resulting  representation  is  a  monotonic 
point  (i.e.,  discrete)  function  with  a  vector  argument. 
This  is  directly  analo«jous  to  the  implementation  by  Novicic, 
et  alia,  cited  above. 

Because  of  the  formulation  of  the  mcdel,  every  point  in 
the  underlying  .space  must  be  involved  in  a  gamble  in  order 
that  a  utility  for  every  point  be  inferrable.  There  n,»y  l,e 
a  large  number  of  points  in  the  space.  Suppose,  tor  <'Xara- 
ple,  that  we  wish  to  infer  utilities  in  a  t  hr  ee  -  d  i  mi.  n.ui  ona  1 
.space.  We  might  then  choo.se,  for  example,  nine-  points  of 
interest  alon.j  each  of  the  three-  dimensions.  If  wc  wi.sh  to 
view  the  complete  product  .space  of  these  throe-  dimensions, 
we  have  9*9*9  =  7  29  points  in  the  space,  .ind  therefore  72/ 
utilities  to  infer!  (Recall  that  we  a.ssiimc  that  the  least 
preferred  [joint  har:  u  t  i  1  .i  y  zero  and  t  lit  most  ['r<'f>ii<ii 
[’oint  has  utility  nn<^.) 

As  the  number  of  util  it  ie.^  to  be  estimated  is  so  largo, 
the  number  of  gamble.',  for  which  ind  r  1  ?  na  nee  {'r  o  ba  !;  i  1  i  t  i  >.  ■. 
must  be  elrorted  i:.  al.so  l.irge.  Wr  would  like  to  (ie;i  nt 


many  more  gamble.'',  than  pa  ra  me  1 1- r  .s ,  thu;  i:  v  e  r  f  i  1 1  i  n  g  t  he 
model  and  alltawinj  for  coherence  checking.  We  expect,  that 
this  straight-forwarvi  exten.cxcp.  of  the  Ncvic;k  .:i. a  Lii.dl*  y 
procedure  will  be  tedious  fer  the  deci.e:  on  E'ak,.r  ana 
therefore  not  fea.sifde  in  most 

Using  the  results  cl  tha  *:h‘ror:.eS  ci  {wlynomial  con¬ 
joint  measurement,  we  do  have  ar:  appealing  a  1 1  e  i  n  ,i  t  i  ve  .  If 
Me  are  willing  to  a^;sume  a  polynomial  representation  of  tiie 
overall  mu  1 1  ia  1 1  r  i  bu  t  c  ut.-lity  f  unction  in  teim-s  ot  the  ma'- 
ginal  utility  function.'!,  we  can  achieve-  some  parsimony. 
This  gain  in  parsimony  is  not  without  cost,  however;  the 
cTost  IS  discu.'.ssc'd  in  Secticn  3. 

As  an  example-,  we  might  ;;  up  pose  tr.  at  a  t  ou  i  t  h  -  d  e  gi 
polynomial  r  e  [;  r  ese  n  ta  t  ion  would  be  .'vuflicitnt  to  adeguattiy 
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a  !i  d 


ot  the  least  and  the  mo:.;t  pueieciCil  state:,,  and  .issiiuiii.  j 
that  every  point  in  the  product  s[:ace  is  attainallt-  (a 
relaxable  assumption),  the  weights  in  the  [0 1 y no  mi  a  1 
representation  must  be  greater  than  cr  equal  to  zero,  be 
less  tlian  or  equal  to  one,  and  sum  to  one.  These 
constraints  are  not  particularly  difficult  aiiO  can  t-asily  be 
implemented  with  well-known  numerical  neth.jd. s. 


To  see  the  parsimony  of  tlie  model,  wr  mu.st  determine 
the  number  of  parameters  that  must  be  inferred.  If  we  wish 
to  represent  the  same  three-dimensional  model  used  as  an 
example  above,  we  have  three  uniattribute  utility  lunction;; 
of  nine  states  each  and  thirty-feur  weights  in  t h< 
polynomial  function.  This  gives  lifty-livi-  parameters  to 
infer  (recall  that  two  utilities  in  each  of  ttio  three 
utility  [loint  functions  arc  fix<^d)  .  Thus  the’  jolynoici.il 
representation  requires  conr:id<.i  ilily  f*  w.  i  ;  a  r  a  m  e- 1  ,  (hh 

compared  to  717)  ! 


To  imp’loment  ttiG  {'olynoraial  i  e  p i  s  en  t a  t  ion  ,  w._  if;le:i 

back  to  Young's  general  conioint  measurement  model  (equation 
V.2.2).  In  the  formulation  of  thi-  Novick  and  bind  ley  model, 
wp  observed,  ttiat  tiie  function  h  (.)  was  ,i  n  icientity  func¬ 
tion.  By  using  a  f  ou  i  t  h  -  d  e  q  i  ee  (olyncicial  function  loi 
we  get  our  d. esire<l  i  c- p  i  <  e  r.  t  a  t  io  n  . 


h  ^  ( . )  i  n  51 1  e  a  d  , 


Noirf  udut  t  o  look  jt  Tiit'  S’Kjti  ic  11:  .;.  loi.  ai  *  i  :.■ 

1  !i 'i  1 1 1  e  r  o  n  c  e  i  ob  .1  Di  1 1 1  i^s:  to  vii.:  'ibis  , 

cl  concern  regdiilles-s  ol  tin  ^  oj  i  t  i  1 1;  w-  i  t.-,. 

ufi.  litiec.  In  the  ori'jinal  Nov^c^  a  ns  Lindlty  i  s  i  .t  a  1  1 1  i  o  n  , 

file  logo'Idc  :Detiic  w  ,3  s  ;-:fcl«-:CT  i.a  b.  caU.  ..  it  w,ti,  'Inni  :;.t  tijat 

t  ii  c  r.  a  b  i  oc  1 1  V  I-  m  ni  .'I'l  i;  e  ec  n  1  in  tin-  t  ,1 1  ]  <,  t  'lomniii  (1.1.., 

indifference  r  oba  b  1 1  ^  t  i  ec  neai  it  is'  .71,  ;;c  ji  cr;el  woulii  1  ■■ 

aorc-  precise  tiuin  in  the  mi  dal*-  •  ■  t  t  n acttjir.  .',0  ai.  a.;")Ljst- 

iicj  t  r  3  rs  f  or  ma  t  i  on  w.is  rier-ied.  p,.<-pni  lecT-dich  ;:i.owr: 

that  thi:;  ic  not  n  e  .:es  .'-.vi  r  :  1  y  the  'ase  ( '■' a  s  K  a  w  a  ,  I'jrl)  . 

The  use  of  any  1 1  siccil  cruiat  ion  ( .  j  .  ,  1  di'cs.r.-: 

of  the-  square  root)  fstr  t'.ucli  put  poses  i  .in  is-  viewoc  as  j 
scaiir!;  oj.-rition  (see  J.uce  and  Tukey,  ojii)  .  fc:  ti;t 
reasonic  cited  n  the  i.uce  and  Tuk'.y  pa|er,  *■ ;.  li  t  w  .  t 

tiie  use  of  .1  [.iiti'-ulai  t  ua  iio:  oi  ::j  t  i(,;.  or..-  oes  net 

wfietiier  a  different  t  r  ariotcr  mi  t  ici.  tiant  ;.av..-  jiv*:. 

di.lierent  r<>;;ults,  -hi  use  of  a  lo-;  al  icnstenc-  1 1 3  ns.  f  o  i  .ns - 

tion  uii'jtit  be  advi;-, able. 

Finally,  ws-  addre.s.s  t  rc  iio^lie.r  •!  iilatin;  tic 
inferred  util.ty  .sisice  witli  ti.t-  le.eie-L  1  y  j.  i..,  'Sbiect  s.p.ics.  :i 

the  undetlyiiij  object  s[.er..  .s  in  tact  .':,;c:.-t.  ,  : 

utilities  have  iHonu  --x  i.aust  1  ve  1  y  inf*  ;  r  *  .j  y  tic-  p;  -  , 

advocat.ad  .ibcve,  there-  1 -s  nothing  iiici-.  to  i.'.  It  ;  ■  !■ 

tie-  c  1 ' ,  ,  h  .1  w  • '  V  .  ■!  ,  I  -i  r  t  1  < ;  I)  1  \  I  i  y  1  a  <•  ;  u  ca  t  1  <  1,  '  a  f  :  .  .  • 
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that  the  underlying  object  space  is  a  subset  of  the  product 
space  of  the  real  numbers  (e.g.,  each  dimension  in  the  space 
is  a  subset  of  the  real  numbers) .  In  such  cases,  it  is 
useful  to  construct  a  functional  relationship  between  the 
derived  utility  space  and  the  underlying  space. 

In  the  unidimensional  case,  examples  of  this  construc¬ 
tion  may  be  found  in  Novick,  et  alia  (Isaacs  and  Novick, 
1978;  Novick  and  Lindley,  1979;  Novick,  Hamer,  Libby,  Chen, 
and  Woodworth,  1980) ,  where  pieces  of  probability  functions 
are  fit  to  the  utility  point  function.  In  the  mul¬ 
tidimensional  case,  examples  may  be  found  in  Ward,  et  alia 
(Ward,  1977;  Hendrix,  Ward,  Pina,  and  Haney,  1979;  Hard, 
Pina,  Fast,  and  Roberts,  1979)  ,  where  techniques  of  "policy 
capturing"  and  "policy  specifying”  are  used.  Policy  captur¬ 
ing  involves  predicting  the  behavior  of  a  judge  with 
relevant  variables.  This  is  also  called  "bootstrapping" 
(see  Dawes,  1973) .  Policy  specifying  involves  logically 
specifying  functional  relationships  among  relevant  variables 
in  a  hierarchical,  binary  tree  fashion  to  develop  a  model. 

Presumably,  one  could  fit  pieces  of  probability  func¬ 
tions  to  the  marginal  utility  functions  derived  above.  A 
simpler  method  would  be  to  employ  a  technique  similar  to  the 
bootstrapping  in  Hard,  et  alia.  Instead  of  using  the 
utility  estimates  specified  by  a  judge,  however,  one  might 
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infer  the  aarginal  utilities  from  the  behavior  of  a  judge  in 
the  manner  described  above  and  then  fit  polynomial  functions 
of  the  variables  in  the  underlying  space  to  the  marginal 
utility  functions. 

Thus  we  have  the  following  two-stage  model  of 
utilities.  Let  o  be  an  arbitrary  point  in  the  underlying 
space.  Then 

(¥.2.4)  u  (0  )  =  {u  {‘^)  ) 

where  P^(-)  is  a  fourth-degree  polynomial  of  its  arguments, 
with  crossproducts,  and 

( V .  2. 5)  u  (^)  =  (n) 

where  3^(0  is  a  system  (vector)  of  fourth-degree 
polynomial  functions  of  the  components  of  o •  Note  that  each 
of  the  components  of  the  vector  u(.),  the  marginal  utility 
functions,  is  a  polynomial  function  of  all  the  components, 
and  crossproducts,  of  the  underlying  space.  This  complexity 
gives  us  considerable  flexibility  in  mapping  the  distortion 
from  the  underlying  object  space  to  the  utility  space. 

Implications  of  this  model  and  a  couple  of  submodels 
are  discussed  in  the  next  section. 
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Section  3.  Discussion  of  the  Poljnoaial  Hodel 


As  we  showed  in  Section  2,  the  polynomial  representa¬ 
tion  can  provide  us  with  a  more  parsimonious  model  than  the 
point  function  representation  covering  the  entire  underlying 


object 

space.  Parsimony 

not  only  give 

us  a  conceptually 

simpler 

model,  but  also  one 

that  is  easier  to 

estimate . 

Because 

there  are  fewer 

parameters  for 

which 

to  infer 

values. 

our  elicitation,  or 

data  collection 

,  task 

is  much 

simpler 

and  therefore  less 

tedious  to  both 

the  the 

measurer 

(which  nay  be  a  computer)  and  the  decision  maker  (from  whom 
the  data  are  elicited) . 

The  polynomial  model  is  not  without  costs,  however,  as 
intimated  above.  The  major  costs  are  (a)  it  is  an 
approximation  except  in  strictly  defined  situations,  (b) 
there  are  no  tests  for  correctness  except  in  a  few  special 
cases,  and  (c)  there  is  no  theory  of  error  or  distribution. 

The  strength  of  the  model,  as  stated  by  Tversky  (1967a) 
and  quoted  in  Chapter  IV,  is  that  a  polynomial  function  is 
very  versatile.  A  polynomial  function  can  be  found  to 
approximate  any  bounded,  continuous  surface.  It  is  still  an 
approximation  and  therefore  does  not  fit  exactly,  in 
general.  Thus,  it  becomes  important  to  have  testable  con¬ 
ditions  of  correctness  of  the  model,  to  identify  those  cases 
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when  the  fit  is  exact,  or  a  strong  error  theory  to  support 
and  evaluate  the  approximation. 

Except  for  simple  cases,  there  are  no  testable  con¬ 
ditions  for  the  general  polynomial  model  (Tversky,  1967a; 
Krantz,  Luce,  Suppes,  and  Tversky,  1972) .  Two  of  the 
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1976)  . 

Conditions  for  the  appropriateness  of  certain  simple 
distributive  models  have  been  investigated  (Krantz,  Luce, 
Suppes,  and  Tversky,  1972) .  Conditions  for  simple  bilinear 
forms  have  also  been  studied  (Fishburn,  1973b).  These 
models  are  all  simple  and  at  least  suffer  from  the  flaw  that 
the  conditional  utilities,  those  derived  from  fixing  all  but 
one  attribute  at  some  combination  of  levels,  are  all  linear 
functions  of  the  marginal  utility  of  the  remaining  variable 
attribute. 
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assumption 

of  infall 

ible 

data . 

There 

exists  no  theory 

of 

error  or  of  distribution.  If  one  of  the  axioms,  say  the 
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transitivity  part  of  the  weak  ordering  axiom,  fails  then  the 
model  fails.  The  failure  of  transitivity  could  be  due  to 
error  of  measurement,  but  there  is  no  way  cf  accounting  for 
this  in  the  current  theories  of  conjoint  measurement. 

One  approximation  to  a  solution  to  the  problem  of  model 
selection  with  fallible  data  is  a  procedure  like  that  used 
in  regression  analysis  or  the  analysis  of  variance.  As 
indicated  in  a  previous  chapter,  classical  regression 
analysis  and  analysis  of  variance  can  be  considered  as  con¬ 
joint  measurement  problems  with  strong  metric  assumptions. 
One  could  infer  the  overall  multiattribute  utility  function 
and,  using  it  as  the  dependent  variable,  apply  one  of  the 
model  selection  algorithms  of  classical  regression  analysis 
to  the  proposed  model. 

There  are  two  major  difficulties  with  this  approach, 
however.  One  is  again  concerned  with  the  lack  of  a  theory 
of  error  or  distribution.  The  dependent  variable  not  only 
has  no  established  theory  of  error  but  is  also  inferred,  not 
observed.  Secondly,  the  procedure  requires  that  a  large 
number  of  parameters  be  inferred.  Not  only  must  the  entire 
overall  utility  point  function  be  inferred,  but  also  all  the 
parameters  in  the  model.  Ve  do  end  with  a  more  parsimonious 
model,  but  a  considerable  data  collection  task  is  required. 
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Finally,  the  proposed  polynomial  model  is  not  always 
sufficiently  more  parsimonious  than  the  general  point  func¬ 
tion  to  be  worth  the  effort.  The  example  selected  above  to 
illustrate  the  polynomial  model  cast  it  in  a  good  light. 
Indeed,  when  one  is  interested  in  a  three-dimensional  or 
higher  representation  with  many  points  along  each  dimension, 
the  polynomial  representation  will  be  more  parsimonious. 
When  one  is  interested  in  a  two-dimensional  representation, 
the  advantage  of  the  polynomial  model  disappears.  In  the 
three-dimensional  case,  the  general  polynomial  model  becomes 
attractive  only  if  we  are  modelling  more  than  five  points 
along  each  dimension. 

Since  many  of  the  applications  of  interest  are  likely 
to  involve  models  of  low  dimensionality,  generally  two  or 
three  because  of  the  conceptual  simplicity,  the  polynomial 
representation  may  be  marginally  useful  in  practice. 

The  general  polynomial  formulation  does  have  two  sub¬ 
models  that  are  of  some  interpretational  interest.  First, 
if  in  equation  (V.2.5)  the  system  of  polynomial  equations 

g  (-)  degenerates  into  a  single  polynomial  function  q  (.), 
4  4 

and  equation  (V.2.h)  is  taken  to  be  an  identity  function,  we 
have  a  polynomial  fit  of  the  variables  of  the  underlying 
object  space  to  the  overall  utility  point  function.  This  is 
essentially  the  "policy  capturing"  paradigm  of  Ward,  et 
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alia,  cited  above. 

Second,  if  we  let  each  equation  in  the  system  of 
polynomial  equations  (V.2.5)  be  a  function  of  only  one 
argument,  i.e.,  involve  only  one  of  the  dimensions  in  the 
underlying  object  space,  ve  get  a  simpler  model.  Note, 
houever,  the  implications  of  this  model.  In  the  general 
polynomial  model,  ve  allow  any  polynomial  rotational  distor¬ 
tion  between  the  underlying  space  and  the  utility  space  to 
be  modelled.  It  is  even  possible  for  the  underlying  space 
to  be  collapsed  into  a  utility  space  of  fewer  dimensions  (or 
expanded  into  more  dimensions) .  This  second  submodel 
assumes  a  rotational  restriction.  It  is  assumed  that  the 
dimensions  of  the  utility  space  are  the  same  as  those  for 
the  underlying  object  space  and  it  is  merely  the  scale  on 
each  axis  that  is  distorted. 

These  two  submodels  are  conceptually  interesting  in 
certain  situations  but  they  do  not  address  the  major 
problems  in  the  application  of  the  polynomial  model.  The 
problems  of  correctness  of  the  model  and  goodness  of  fit 


still  remain. 
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Ch3£ter  VI  CONDITION^  Dllilll  ASSESSMENT 


Section  1.  Introduction 

In  this  chapter  ye  will  present  two  axiomati zations  ot 
conditional  subjective  expected  utility  and  use  them  to 
justify  the  method  of  multiattr ibute  utility  assessment  that 
is  the  goal  of  this  paper.  The  emphasis  on  conditional  sub¬ 
jective  expected  utility  theory  is  in  response  to  criticisms 
of  the  axiomatizations  of  von  Neumann  and  Morgenstern  and  of 
Savage,  presented  in  Chapter  II,  which  are  both  uncon¬ 
ditional  theories. 

The  unconditional  theories  define  as  primitive  elements 
sets  that  represent  consequences,  acts,  and  states  of  the 
world.  It  is  assumed  that  the  states  of  the  world  and  the 
relationships  between  them  and  the  consequences  are  unaffec¬ 
ted  by  the  choice  of  the  acts.  In  other  words,  it  is 
assumed  that  one  and  only  one  state  of  the  world  is  true  and 
this  fact  is  unalterable  by  the  choice  of  an  act  by  the 
decision  maker. 

There  have  been  several  criticism  of  this  assumption  in 


the  literature  (Luce  and  Krantz 


19  71;  Fishbur  n 


1973c; 
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Fishburn,  1974;  Balch,  1974;  Balch  and  Fishburn,  1974). 
Briefly,  these  objections  center  on  the  unconditional  nature 
of  the  theory  (i.e.,  that  the  choice  of  act  for  implenenta- 
tion  can  have  no  effect  on  the  state  of  the  world  obtained) 
and  the  proposition  of  'constant  acts'  (i.e.,  acts  that 
produce  the  same  consequence  regardless  of  the  true  state  of 
the  world) . 

In  response  to  these  objections,  two  theories  of  con¬ 
ditional  subjective  expected  utility  have  been  developed 
(Luce  and  Krantz,  1971;  Fishburn,  1973c).  These  two 
axiomatizations  are  presented  here  for  reference,  the  Luce 
and  Krantz  axioinatization  in  Section  2  and  the  Fishburn 
axiomatization  in  Section  3. 

In  the  Luce  and  Krantz  theory,  the  primitive  elements 
are  events,  or  states  of  the  world,  consequences,  and  acts, 
which  are  functions  from  the  set  of  events  into  the  set  of 
consequences.  The  acts  are  conditional,  on  subsets  of  the 
set  of  events,  and  the  theory  provides  for  a  measurable 
utility  and  conditional  subjective  probabilities  on  these 
conditional  acts.  The  authors  prove  an  additional  theorem 
that  provides  a  measurable  utility  on  the  set  of 
consequences.  The  application  of  the  theory  is  restricted, 
however,  to  those  sets  that  include  all  subsets  and  finite 
unions  of  disjoint  subsets  of  the  set  of  events  of  interest. 
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In  the  Fi.shburn  theory,  there  is  no  such  restriction  on 
the  set  of  events,  but  the  set  of  acts  is  more  restrictive, 
being  a  "mixture  set"  of  all  simple  acts,  those  that  obtain 
a  single  consequence  (Krantz  and  Luce,  1974) .  It  is  this 
enrichment  of  the  set  of  available  acts  that  allows  the 
theory  to  be  applied  to  a  less  restrictive  set  of  states  of 
the  world. 

In  Section  h,  these  theories  are  discussed  in  terras  of 
their  applicability  to  the  situation  under  consideration  in 
this  paper,  namely  raultiattribute  utility  assessment.  Of 
particular  interest  is  the  manner  in  which  each  of  the 
theories  avoids  involving  consequences.  Although  each 
theory  may  be  formulated  in  terms  of  consequences  --  Luce 
and  Krantz  (1971)  prove  a  secondary  theorem  and  Fishburn's 
act-state  pairs  (1973c)  may  be  called  consequences  without 
loss  of  generality  (Pratt,  1974)  --  both  avoid  bringing 
consequences  into  the  theory  at  an  axiomatic  level  where 
they  might  provide  intuitive  appeal.  In  this  regard,  com¬ 
ments  by  Jeffrey  (1974)  are  cited  that  motivate  a  "new" 
axiomatization  of  conditional  subjective  expected  utility. 

In  addition,  these  formulations  allow  us  to  address  the 
problem  of  structure  in  a  multiattribute  situation.  We  show 
that  uniattribute  utility  functions  may  be  constructed  that 
are  conditional  expected  utilities  of  the  overall  utility 


.  1 
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function.  We  also  show  that  the  Noviclc  and  Lindley  fixed- 
state  utility  assessment  procedure  may  be  viewed  as  a  con¬ 
ditional  subjective  expected  utility  procedure.  If  we  view 
the  utility  function  as  if  it  were  a  probability  measure, 
some  interesting  interpretations  develop. 


Section  2.  The  Luce  and  Krantz  Axiomatization 

In  this  section,  we  present  an  axiomatization  that 
leads  to  a  simultaneous  measurement  of  utility  and  subjec¬ 
tive  probability  (Luce  and  Krantz,  1971).  The  axioms  are 
similar  in  nature  to  those  in  the  previously  presented 
axiomatizations,  and  the  resulting  representation  is  similar 
though  specifically  formulated  for  the  application  to 
utility  assessment. 

The  intention  of  the  axiomatization  is  to  provide  a 
theoretical  measurement  foundation  for  utility  assessment 
formulated  in  a  more  realistic  way  than  the  axiomatizations 
of  utility  developed  by  von  Neumann  and  Horgenstern  (1947) 
and  by  Savage  (1954).  The  difficulty  with  these  two 
previous  axiomatizations,  according  to  Luce  and  Krantz,  is 
their  representation  of  utility  unconditionally. 
Specifically,  both  previous  axiomatizations  of  utility 
reguire  that  the  states  of  nature  can  no  way  be  altered  by 


Luc  c 


Lhe  acts  chosen  by  the  decision  maker.  In  most  cases, 
and  Krantz  argue,  the  decisions  that  we  as  decision  makers 
consider  limit  the  domain  of  possible  events,  thus  altering 
our  perceived  subjective  probability  of  t.'ie  occurrences  of 
those  events  as  well  as  our  perceived  utilities  for  the 
outcomes. 

The  axioms  proposed  by  Luce  and  hrantz  are  presented  in 

Table  VI. 2.1.  As  stated  by  the  above  authers; 

They  are  mostly  not  transparent  at  first  sight, 
but  they  become  reasonably  compelling  as  normative 
principles  once  their  meanings  are  grasped. 

Axioms  1,  8,  and  9  are  structural,  guaranteeing  that  the 

sets  under  consideration  are  sufficiently  rich  to  provide  a 

basis  for  applying  the  other  axioms  and  tc  insure  a  solution 

to  certain  equivalence  ''elations.  The  other  axioms,  2 

through  7,  are  described  as  "rational  preference  behavior 

axioms"  by  Luce  and  Krantz.  These  are  similar  to  axioms  in 

other  axiomatizations  of  utility  that  are  normative  (what 

one  should  do)  rather  than  descriptive  (what  one  does) . 

Axiom  1  insures  thrt  all  possible  combinations  of  con¬ 
ditional  decisions  are  represented  in  the  set  of  decisions 
under  consideration.  Note  that  some  of  these  may  be  not 
meaningful.  As  Luce  and  Krantz  state: 

To  apiily  our  theory  to  real-world  decisions,  we 
must  therefore  suppose  that  "natural"  decisions, 
such  as  f-  and  g,,  (in  Table  VI.  2.  1)  ,  are  enriched 
by  certain  artificial  ones....  The  measurer  must 
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The  Luce-Krantz  Axiomat izat ion 
(Luce  and  Krantz  1971) 

Let  i  be  an  algebra  of  events  (i -  e.,  closed  under 
unions  and  compliments)  of  subsets  of  a  given  set  i  of  pos¬ 
sible  chance  events;  let  M  be  null  events,  a  subset  of  1  , 
including  at  least  the  empty  set  0,  that  is  characterized  by 
the  axioms  and  that  will  be  the  events  assigned  probability 
zero  in  the  representation;  let  C  be  consequences,  an 
arbitrary  set;  let  V  be  conditional  decisions,  a  set  of 
functions  from  non-null  events  (t-M)  into  C;  and  let  >  be  a 
preference  ordering,  a  binary  relation  over  V. 


1=  <x»£/W,c,p,  >> 


decision  structure  if  for  all  A,  B  in  L-N,  R 

^auB'  ^AUR'  ’'b 

nine  axioms  are  satisfied. 


AZiSS  !•  (i)  if  A  A  B  =  0,  then  f^  0  gj^  is 

E  c  A,  then  f^  is  restricted  to  B  in  V. 
Axiom  2;  >  is  a  weak  ordering  of  0. 


Axiom  3:  If  A  0  B  =  0  and  then  f^ 


is  a  conditional 
,  S,  in  i  ,  and 
D,  the  following 

in  V  ;  (ii)  if 


u  gg  - 


A 
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Table  VI.2.1 
(continued) 


Axiom  4;  If  A  n  B  = 


0,  then  f >  f if  and  only  if  U  <]. 


>  f."  U  Sr- 


5:  If  A  3  B  =  j3,  %'  i-'**  2 

2  1  L  2 

U  Kq,  and  U  h.^ 

and  only  if  u  0  g^**. 


“  “b  ■'■  «■: 

‘a  “  i  ‘a'  "  'Ss"  if 


Axiom  6:  If  A  I  B  =  0,  N  is  a  sequence  of  consecutive 
integers,  not  g^  ,  and  f^  ^  ^ 

i*1  in  N,  then  either  N  is  infinite  or  {  f (  i  is  in  N  i 
is  unbounded. 


Axiom  7:  (i)  If  R  is  in  V  and  ScR,  then  S  is  in 

(ii)  R  is  in  hi  if  and  only  if,  for  all  f,,,,,  in  V  ,  f,,  . 

AUK  Al. 

'V  f  ,  where  f^  is  the  restriction  of  f,,.,,  to  A. 

A  A  AUK 

A*i25  M*  (i)  ^  contains  at  least  three  pairwise  disjoint 
elements;  (ii)  /  v  contains  at  least  two  distinct 
equivalence  classes. 

Axiom  9:  (i)  If  A  and  q„  are  given,  then  there  exists  h.  in 

for  which  93 1  (ii)  if  A  ^  ~  B  and  h^^  0  gj.  > 

^AUD  ~  ^A^  ^  '  f)’®"  there  exists  h.^  in  V  such  that  h^ 

^  ''  ^AUB  ■ 
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be  prepared  to  present  for  serious  consideration 
by  the  decision  maker  some  rather  artificial 
alternatives,  and  the  decision  maker  must  be 
induced  to  make  realistic  decisions  among  them. 

The  usual  technique  is  to  pose  hypothetical 
questions. 

Note  that  this  is  the  practice  of  the  Novick  and  Lindley 
procedure  described  in  Chapter  II. 

Axiom  2  is  analogous  to  axioms  in  the  Luce-Tukey,  the 
Hoskies,  and  the  Tversky  systems.  It  means  that  the  binary 
relation  >  is  reflexive  and  transitive.  Axiom  3  simply 
means  that  if  two  decisions  are  equivalent  in  preference, 
then  a  decision  that  randomly  provides  one  or  the  other  is 
equivalent  to  either. 

Axiom  4  states  that  if  one  decision  is  at  least  as 
preferable  as  another,  then  the  preference  ordering  should 
remain  the  same  when  both  are  combined  with  some  other, 
unrelated  decision.  Axiom  5  is  the  one  that  helps  to 
guarantee  that  the  resulting  utility  representation  will 
attain  at  least  an  interval  scale  of  measurement  by 
postulating  that  there  be  no  reversals  in  preference.  Axiom 
6  is  an  Archimedean  axiom  like  those  in  other 
dxiomatizations. 

Axiom  7  is  concerned  with  the  events  that  will  have 
zero  probability  in  the  resulting  representation, 
guaranteeing  that  subsets  of  null  events  are  themselves  null 


and  that  null  events  have  no  influence  on  non-null 
decisions.  Axiom  8  is  another  of  the  structural  axioms, 
insuring  that  the  sets  in  question  have  sufficiently  many 
elements  so  that  the  axioms  are  applicable.  The  notation, 
denotes  the  set  of  all  equivalence  classes  derived  from 
D-  Axiom  9  is  a  solvability  axiom  similar  to  those  in  other 
axiomatizations. 


The  primary  result  of  the  axiomatization  is  the  follow¬ 
ing  theorem: 

Theorem  j ;  Suppose  that  <  i  ,  ^  ,  I' ,  >  >  is  a 

conditional  structure  in  the  sense  of  Definition 
1.  Then  there  exist  real-valued  functions  u  on  l' 
and  P  on  i  such  that  <  P  >  is  a  finitely 

additive  probability  space  and,  for  all  A,  B  in 
f-'V,  R  in  i  ,  and  in  P, 

(i)  R  is  in  W  if  and  only  if  P  (R)  =  0; 

(ii)  f.  >  3_,  if  and  only  if  u  (f  )  >  u  (a  )  ; 

(iii)  if  An  B  =  0  »  then 

U(f^Ug^)  =  u(f^  )  P(M  ADB)  (g,)  P{B|  AUB)  . 

Moreover,  P  is  unique  and  u  is  unique  up  to  a 
positive  linear  transformation. 

It  should  be  noted  that  this  theorem  does  not  assign  a 

utility  function  to  the  set  of  consequences,  but  to  the  set 

of  conditional  decisions.  Thus,  as  stated  by  Luce  and 

Krantz,  "they  do  not  seem  to  fulfill  our  original  goal  and 

certainly  they  are  different  in  this  respect  from  all  other 

theorems  of  expected  utility."  In  particular,  these  refer 

to  the  axiomatizations  by  von  Neumann  and  Horgenstern  and  by 

Savage.  Another  theorem  is  proved  by  Luce  and  Krantz  that 


r  - - 

lOh 

establishes  a  utility  function  defined  on  the  consequences. 
Luce  and  Krantz  are  also  able  to  show  that,  for  the  finite 
case,  any  conditional  aodel  with  their  representation  can  be 

i  restated  in  an  equivalent  unconditional  fora,  and  vice 

I 

versa. 


Section  3.  The  Fishburn  Axioaatization 

In  this  section  ve  present  a  second  axiomatization  of 
conditional  subjective  expected  utility  (Fishburn,  197Jc; 
Fishburn,  1974).  The  set  of  states  cl  the  wotl'l  is 
generalized  from  that  of  Luce  and  Krantz,  in  that  there  i; 
no  requirement  that  all  unions  and  subsets  be  included.  To 
achieve  the  desired  representation,  however,  the  set  ol 
acts,  or  decisions  or  gambles,  is  enriched  to  be  a  "mixture 
set." 


A  mixture  set  is  defined  as  follows  (Herstein  and  Bil- 
nor ,  1953) : 

A  set  S  is  said  to  be  a  mixture  set  if  for  any  a, 
b  in  S  and  for  any  p  we  can  associate  another 
element,  which  we  write  as  pa  ♦  (1-p)b,  which  i.s 

again  in  S,  and  where 

la  ♦  (1-1)a  =  a. 


The  resulting  repiesent at  ion  is  not  su bs ta nt ia 1 1 y  different 
troB  that  of  Luce  and  Krantz  (1974).  Cne  representation 
does  not  dominate  the  other  so  that  the  choice  must  be 
dependent  on  the  situation  or  sets  undf r  consideration  or 
those  li)cely  to  occur. 

Table  VI.  i.  1  presents  the  axicoii  of  the  Fishburn 
system.  They  are  fully  discussed  in  the  criginal  presenta- 


tion  (Fishburn, 

1973 c)  and 

so  will  not  be 

discussed  in 

detail  here. 

The 

Fish  f:  urn 

paper  also  cites 

situations  and 

conseguences  of 

the 

t  a  1 1 ur  e 

of  certain  of  the 

axioms.  Thi 

impli cations  of  each  of  the  axioms  are  briefly  presented 
be  low . 

Axiom  (A1)  means  that  the  preference  relation  >  is 
isymmetric  (a>b  ->  not  b>a)  and  negatively  transitive  (not 
a>b  not  b>c  not  a>c)  .  Defining  "indifference"  (  )  as 

a'  b  if  and  only  if  not  a>b  5  net  b>a 

and  "preference-indifference"  (>)  a.s 

a>b  if  and  only  if  a>b  or  a-b, 

it  follows  that  '<  i.s  an  eguivalence  relation  (reflexive, 
symmetric,  and  transitive)  and  >  is  transitive  and  cromjlete. 


Axiom  (A2)  is  a  continuity  axiom,  similar  in  intent  to 
the  Archimedean  axioms  of  the  systems  (resented  in  previous 
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Table  II-3._1 

The  Fishburn  Axioaatization 
(Fishburn,  1973c) 

J-  {  \  ,  i  ,>)  is  an  ordered  algebraic  mixture 
system  if  and  only  if  v  is  a  mixture  set,  ;  is  a  Boolean 
algebra  of  the  set  S  of  states  of  the  world,  >  is  a  binary 
relation  on  \  xl  •  (where  i  •  =  t  -  0  ■)  and,  for  all  A,  B,  c  in 
L  '  and  x,  y,  z,  w  in  ; 

(A1)  >  is  a  weak  order, 

{A2)  {p:  (?*♦  (l-p)  y)  A  >  zB}  and  p:  zE  >  (px+ (1 -p)  y) )  A 

are  closed  (in  the  relative  usual  topology  for  (0,1)), 
(A3)  XA  ZF!  t  yA  wD  ->  (.5x  +  .5y)A  .  (.5z+.‘>w)E, 

(A4)  A  1  B  =  0  C  xA  >  xB  ->  xA  >  x{AUE)  >  xB, 

(A5)  X  >  y  for  some  x,  y  in  X  , 

(A6)  A  n  B  =  jj->  xA  >  xE  8  yE  >  yA  for  some  x,  y  in  ^  , 

(A7)  If  A,  B,  C  are  mutually  disjoint  and  if  there  is  an  x 

in  X  such  that  xA  '•  xB,  then  there  is  a  y  in  such 
that  exactly  two  of  yA,  yB,  and  yC  are  indifferent. 

where  xA,  for  x  in  X  and  A  in  is  written  for  the  ordered 


pair  (x,A)  in  \xl'  and  xS,  for  x  in  \, 


is  abbreviated  x. 
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Table  VI-3.1 
(continued) 

Theorem  J:  Suppose  that  (K,  ( ,  >)  is  an  ordered  algebraic 
mixture  system.  Then  there  is  a  real-valued  function  u  on 
\xM  and  a  f initely-additive  probability  measure  on  •  A  P 
li :  B  in  f  ;  for  each  A  in  (  '  such  that  (i)  xA  >  yD  if  and 

only  if  u(xA)  >  u(yB)  for  all  xA,  yE  in  \x[‘;  (ii)  u(.A)  is 

linear  (as  a  function  on  for  each  A  in!  (iii)  Pjj.(A)  = 

P^,  (B)  Py  (A)  whenever  A  c  E  c  C,  A  in  I,  and  B,  C  in  i  '  ;  (iv) 

u(x(A0B))  =  (A)  u  (XA)  e  (B)  u  (X  E)  whenever  x  in  X,  A, 

B  in  (  ' ,  and  A  ii  B  =  0  .  Moreover,  a  real-valued  function  v 
on  \x/'  and  f initely-additive  probability  measures  Q,  on  (  A 
II  B:  B  in  f  )  for  each  A  in  (  '  satisfy  (i)  through  (iv)  in 

place  of  u  and  the  P  when  these  satisfy  (i)  through  (iv)  if 

A 

and  only  if  v  is  a  positive  linear  transformation  of  u  (if 
and  only  if  there  are  numbers  a  >  0  and  t  such  that  v(xA) 
au(xA)  ♦  b  for  all  xA  in  \xl')  and  Q  f  for  each  A  in 
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chapters.  One  implication  of  this  axiom  is  that  the  set  i:. 
empty  only  if  zB  is  not  preferred  (is  preferred)  to  both  xA 

and  y  A . 

Axiom  (A3)  is  crucial  to  provide  the  structure  needed 
to  derive  the  desired  representation.  It  is  a  weak  version 
of  the  sure-thing  axiom  found  in  other  systems.  Axiom  (A4) 
is  an  averaging  axiom  that  acts  in  the  alignment  of  the 
utility  functions  in  the  resulting  representation  so  that 
the  utilities  of  all  the  elements  will  have  the  same,  com¬ 
parable  scale.  These  two  axioms  may  be  difficult  to  accept 
on  face  value.  Axiom  (A3)  is  not  very  intuitively 
appealing,  and  Axiom  (A4) ,  though  intuitively  appealing,  may 
be  unacceptable  because  of  the  possible  value  of  certainty. 

Axiom  (A5)  simply  states  that  there  are  at  least  two 
distinct  elements,  in  terms  of  preference,  in  the  set  V,  and 
Axiom  (A6)  states  that  the  set  ‘  is  rich  enough  so  that 
state  A  is  preferred  to  state  B  for  one  act  but  the  reverse 
IS  true  for  at  least  one  other  act.  The  implication  of  this 
latter  axiom  is  that  no  state  dominates  any  other  state  in 
preference . 

Axiom  (A7)  is  required  to  guarantee  that  the 
probabilities  in  the  r ej r esen t a t ion  are  additive.  Fishburn 
gives  an  example  where  (A  1)  through  (Aii)  ate  satis. tied  but 
(A7)  fails  and  the  probabilities  are  not  additive. 


Section  4.  Conditional  Expected  Utility  Assessaent 


The  difference  betMeen  the  Fishburn  a xiomatization  and 
the  Luce-Krantz  axioraatization  was  described  as  follows 
(Krantz  and  Luce,  1974,  in  comment  to  Balch  and  Fishburn, 
1974)  : 

It  seems  to  us  that  the  chief  difference  between 
the  two  systems  lies  right  at  this  point:  the  LK 
system  imposes  great  richness  on  its  outcome 
structure,  but  can  get  on  with  as  few  as  three 
atomic  events  (or  even  two,  with  a  little  extra 
effort) ;  the  BF  system  can  deal  with  any  set  of 
basic  action  alternatives,  but  utilizes  the 
elaborate  mixture-space  apparatus.  Presumably  the 
latter  apparatus  could  be  made  more  qualitative  by 
moving  in  the  direction  of  the  Savage  axioms;  but 
in  any  case,  what  is  required  is  a  very  fine¬ 
grained  structure  of  events  or  probabilities.  The 
essence  of  this  difference  is  familiar  from  the 
contrast  between  the  utility  measurement  procedure 
of  (Davidson,  Suppes,  and  Siegel  (1957)  and 
Hosteller  and  Hogee  (1951)).  Dees  one  best 
measure  utility  by  trading  off  value  and 
probability  or  by  trading  off  value  against  value? 

The  latter  has  more  face  validity  and  is  more 
easily  generalized  to  situations  where  the  subjec¬ 
tive  probabilities  are  not  well  behaved;  it  is  the 
method  of  Davidson  et  al.  and  of  the  LK  system. 

The  former  method  gets  along  with  a  much  simpler 
structure  of  basic  options;  it  is  the  method  of 
von  Neumann  and  Morgenstern,  Hosteller  and  Nogee, 
Savage,  and  others,  and  is  the  basis  of  the  EF 
system , 

Both  systems  are  usable  in  justifying  the  utility  assessment 
procedure  advocated  by  Novick  and  Lindley,  and  adopted  for 
use  in  this  paper.  The  Fishburn  axiomatization  is  perhaps  a 
more  direct  justification  because  of  its  common  ties  with 
the  works  of  von  Neumann  and  Morgenstern  and  of  Savage. 
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The  Luce  and  Krantz  axiomat izat ion  provides  a 
theoretical  measurement  foundation  for  the  utility  assess¬ 
ment  procedure  advocated  by  Novick  and  Lindley  as  follows. 
The  Hovick-Lindley  procedure  selects  three  states,  assuming 
that  they  are  ordered,  and  equates  the  expected  utility  of  a 
gamble,  involving  the  most  preferred  of  the  three  states  and 
the  least  preferred,  with  the  utility  of  the  third,  middle 
preferred  state.  Although  the  equation  (actually  a  system 
of  such  equations)  can  be  solved  unconditionally,  it  is  con¬ 
venient  to  view  each  equation  conditionally.  It  we  restrict 
our  attention  to  the  three  states,  and  recalling  that  the 
utility  function  is  unique  only  up  to  a  positive  linear 
transformation,  we  may  assume  conditionally  that  the  least 
preferred  state  of  the  three  has  a  utility  of  zero  and  the 

most  preferred  state  has  a  utility  of  one.  Thus,  the  con¬ 

ditional  utility  of  the  the  third  state,  of  middle 
preference,  is  equal  to  the  (conditional)  probability  of  the 
gamble. 

In  the  Luce-Krantz  axiomatization ,  a  single  state  can 
be  represented  as  a  constant  decision  and  a  gamble,  also  a 
decision,  as  a  finite  union  of  constant  decisions.  Thus  we 
can  formulate  the  Novick-Lindley  equations  in  terms  of  a 
gamble  and  a  constant  decision  as  follows:  let  A  1'  it 

pie  for  red  t.it*'  ,  D  ;.state  of  ra  i  d  i  1  v'  ;  i  e  1  e  i  e  n  c  ■'  ,  aii-f  c 

most  pri'telLe'd  :',*-.ate  .  Th<i',ioiH  I  ’ll  t  ti  *  L  ii  -  K  ,i  n  ‘  :  v  ,  *  ■  si; 


allows  us  to  conceive  of  the  utility  of  the  gamble  involving 
the  most  and  the  least  preferred  states,  a  finite  random 
union  of  sets  A  and  C,  as  the  sum  of  the  utilities  of  each 
set  multiplied  by  the  subjective  conditional  probability  of 
its  occurrence.  Then  Axioms  9  and  3  allow  us  to  equate  this 
utility  of  the  gamble  to  the  utility  of  the  third  set  6, 
representing  the  state  of  middle  preference- 

The  Fishburn  axiomatization  also  provides  a  theoretical 
foundation,  as  follows.  As  above,  let  A=iState  of  least 
preference;,  B={state  of  middle  preference^,  and  C=, 'state  of 
most  preference).  Assuming  that  the  axioms  hold.  Theorem  1 
concludes  that 

(VI. 4.1)  u(w(AUC))  -  u(wA)  (■  (C)  u  (wC ) 

for  some  w  in  X.  Axiom  (A2)  guarantees  that 
(VI. 4. 2)  w(ALiC)  =  (px  4-  (l-p)y)  (AUC)  zB 

for  some  x,  y,  z  in  X.  Thus,  by  Theorem  1  again,  u(w(AUC)) 
=  u  (zB)  . 

Since  both  axiom  systems  can  adequately  justify  the 
procedure  adopted  for  this  paper,  the  choice  between  them  is 
one  of  convenience.  Given  that  the  application  of  interest 
(in  educational  selection  and  assignment)  will  likely 
satisfy  the  axioms  of  both  systems,  we  could  assume  both. 


1  14 

thus  providing  a  very  strong  theoretical  base  foi  tht- 
elicitation  procedure. 

One  criticism  of  both  axiom  systems  is  the  absence  of 
the  set  of  consequences  in  the  axioms  and  the  main  theorems. 
This  is  a  minor  fault,  however,  as  both  systems  may  be 
extended  or  reformulated  to  involve  the  set  of  consequences. 
Luce  and  Krantz  (1971)  state  and  prove  a  theorem  that 
provides  utilities  on  the  set  of  consequences,  as  indicated 
in  Section  2.  in  Fishburn’s  axiomatization ,  the  act-state 
pairs  can  be  conceived  as  consequences,  as  pointed  out  by 
Pratt  (1974).  Jeffrey  (1974)  suggests  a  "holistic"  approach 
that  includes  consequences  in  the  set  of  primitive  elements. 
Indeed,  states  of  the  world,  acts,  and  consequences  all  may 
be  viewed  as  events. 

Now  that  we  have  a  firm  theoretical  justification  for 
the  elicitation  procedure  of  Novick  and  Lindley,  we  turn  our 
attention  to  the  multiattribute  situation.  As  in  either 
axiom  system,  let  S  be  the  set  of  states  of  the  world,  and 
let  S  be  multiattribute,  i.e.,  S  =  S^x  S2  x .  . .  xSj^ .  .Similarly, 
:,et  i  =  !  ,  X  X .  .  .  X !  ,  be  the  Boolean  algebra  of  the  set  S. 
For  ease  of  demonstration,  we  will  make  some  stronger  a:;sum- 
pticns  than  necessary,  namely  that  each  f  is  an  interval  on 
the  real  line.  The  extension  illustrated  here  i;;  vali  t  foi 
othtr  types  of  sets  ,  such  as  subsets  of  th»  set  of 


integers,  because  of  the  abstract  nature  of  the  sets  defined 
in  the  axioms. 

With  these  assumptions,  the  theorems  of  either  system 
allow  us  to  conclude,  with  suitable  continuity  extensions, 
that 

(71-4.3)  u(£')  =  J  u(yj ') -P  (O'  ‘  ■  v' )  =  Liu(;£j,^'! 

where  0  is  in  L,  o'  is  in  L*,  0''  is  in  i'*,  and  ^'xi''  =  (. 
Of  particular  interest  is  when  E’  =  for  some  i.  Thus  we 
have  identified  a  unidimensional  utility  function,  u (0)  , 
which  Novick  (1980)  has  called  the  marginal  utility  function 
of  o',  and  have  related  it  to  the  multiattribute  utility 
function  as  its  conditional  expectation  (given  j;').  This  is 
illustrated  in  Figure  VI. 4.1. 

In  addition  to  the  marginal  utility  function,  we  define 

the  conditional  utility  function  as 


★ 


(VI-4.4) 

★ 

0  )  = 

u  ( <: ) 

I  n  t  ,  ( u  (  0  )  ^  ) 

★ 

sup  (u(  <. )  V  )  - 

•k 

iiU^(u(i.)  ^  ) 

where  jj. 

* 

j  are 

in  1 

This  is  simply 

a  rescaling 

of 

t  he 

multiattribute 

utility  function  u  (_ 

')  conditioned 

* 

on 

so 

that  it 

ranges 

from 

zero  to  one.  This  is  illustrated 

in 

Figure  VI. 4. 2- 

at 
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The  conditional  utility  function  is  used  in  the  Novick 
and  Lindley  theory  as  follows.  Let  n.,  u.  ,  ,  three 

1  J  K 

states  ordered  on  preference  such  that  u  <u  (Lj )  <u  (ij^ )  • 
The  theory  states  that 

(¥1.4.5)  =  p  u(2^)  +  (1-p)  u(K) 

for  some  p,  0  <  p  <  1.  Then 


(¥1.4.6) 


u(v^}  -  U(-.) 


Thus,  p  is  the  conditional  utility  of  given  that 

the  least  preferred  state  and  is  the  most  preferred  state 

under  consideration,  i.e.,  that  u(_\)=0  and  u(2j^)  =  1. 


The  conditional  utility  function  may  be  related  to  the 
marginal  utility  function  by  observing  that  the  conditional 
of  the  conditional  utility  function, 
E  (u  (0  1 0 * )  I  0. * )  »  is  equal  to  the  rescaled  marginal  utility 
function: 


(¥1.4.7)  E  lu(0|£  )|  O' J 


u(o': 


-  inf^;  j(^)  |£  ) 
sup^  (u(^)  (^*)  -  infg  (u(£)  j  t^*) 


noting  that  the  restrictions  o*  are  assumed  to  be  a  subset 

* 

of  the  restrictions  n  . 


i 


The  three  equations  (¥1.4.3),  (¥1.4.4),  and  (¥1.4.7) 
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provide  a  framework  for  the  assessment  of  the  multiattribute 
utility  function  u  (jJ)  .  As  the  marginal  and  the  conditional 
utility  functions  are  uniattribute  utility  functions,  we  may 
apply  the  elicitation  procedure  of  Novick  and  Lindley.  He 
may  present  choices  between  a  gamble  and  a  sure  thing  in  any 
suitable  manner.  The  resulting  system  of  nonlinear 
equations  in  expected  utility  may  be  solved  using  any 
suitable  numerical  method-  The  multiattribute  utility  func¬ 
tion  may  then  be  recovered  by  applying  the  relationships 
among  it  and  the  marginal  and  the  conditional  utility  func¬ 
tions  displayed  above. 

As  developed  in  Novick  and  Lindley  (1978),  the  use  of 
convenient  models  for  the  utility  function  and  the 
probability  function  over  the  states  of  interest  can  greatly 
simplify  the  computation  of  expected  utilities.  Those 
authors  suggest  using  a  cumulative  distribution  function  for 
the  utilities  and  conjugate  probability  functions.  This 
suggestion  works  well  in  this  situation.  If  we  limit  our 
attention  to  a  two-attribute  situation  for  the  purpose  of 
illustration,  we  can  see  that 

(VI. h. 8)  u(lij)  --  I’|ri  •  Oj,  T  -  ‘^2^‘''''l  ~  "ij 

and  that 
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Section  1.  Introduction 

In  this  chapter,  we  outline  a  procedure  to  assess  nul- 
tiattribute  utilities.  Details  of  the  procedure  ate 
generally  referenced  to  other  chapters  of  this  paper  or  to 
the  appendices.  The  sections  of  this  chapter  are  divided  as 
follows . 

In  this  section,  the  patadigm  for  the  nultiattribute 
utility  assessment  is  defined  and  the  parameters  of  the 
problem  are  identified.  The  discussion  is  brief  as  the 
problem  has  been  amply  discussed  in  Chapters  I  and  II  of 
this  paper.  The  design  of  the  computer  modules  of  the 
implementaton  of  the  procedure  developed  in  this  paper  is 
discussed  in  this  and  subsequent  sections.  The  utility 
assessment  procedure  is  presented  in  three  phases: 
elicitation,  coherence,  and  modelling. 

In  Section  2,  the  elicitation  phase  is  discussed. 
Again,  the  discussion  is  brief  because  the  procedures 
involved  have  been  presented  in  detail  elsewhere;  for  exam¬ 
ple,  in  Chapter  II  of  this  paper.  Two  elicitation 
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procedures  are  implenented . 

In  the  Conditional  Coherence  Procedure,  a  set  of  gam¬ 
bles  for  a  conditional  set  of  attributes  is  presented;  the 
decision  maker  may  then  review  and  alter  the  indifference 
probability  for  any  gamble  in  the  conditional  set  before 
another  conditional  set  is  presented.  Note  that  this 
procedure  is  analogous  to  the  Global  Coherence  Procedure, 
otherwise  known  as  the  Least-Squares  Coherence  Procedure 
(Novick,  Hamer,  Libby,  Chen,  and  Woodworth,  1980). 

In  the  Regional  Coherence  Procedure,  the  decision  maker 
is  presented  with  additional  coherence  gambles  after  each 
pair  of  gambles  from  a  conditional  set.  The  procedure  is 
like  the  procedure  of  the  same  name  currently  in  the  CADA 
Monitor  (Novick,  Hamer,  Libby,  Chen,  and  Woodworth,  1980). 

In  addition,  two  entry  formats  are  available  (Novick, 
1980;  Novick,  Turner,  and  Novick,  1981).  In  one,  the 
decision  maker  is  presented  with  a  structured,  dynamic 
sequence  of  probabilities  for  each  gamble  triplet  and 
responds  whether  the  gamble  is  preferred,  the  sure  thing  is 
preferred,  or  the  choice  is  indifferent.  In  the  other 
format,  the  decision  maker  is  presented  with  the  same  choice 
between  a  gamble  and  a  sure  thing  and  responds  with  the 
probability  that  would  make  the  choice  indifferent. 
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In  Section  3,  the  coherence  phase  is  discussed.  The 
gamble  triplets  are  presented  along  with  the  elicited 
indifference  probabilities.  If  some  esti nation  has  toiken 
place,  the  estimated,  coherent  indifference  probacilities 
are  presented,  as  well,  along  with  the  estimates  of  the 
parameters  of  the  model  chosen  for  the  utilities.  The 
decision  maker  may  modify  or  delete  any  of  the  gamble 
triplets  from  the  modelling  phase.  The  decision  maker  may 
also  reguest  that  additional  gamble  triplets  be  presented 
for  coherence  checking.  This  phase  is  entered  after  the 
modelling  phase  for  acceptance  of  the  estimates  by  the 
decision  maker. 

In  Section  h,  the  modelling  phase  is  discussed.  A  non¬ 
linear  least-squares  algorithm,  based  on  the  Newton-Fapbson 
method,  is  used  to  estimate  the  parameters  of  the 
probability  distribution  chosen  to  model  the  utilities  of 
the  problem.  Three  utility  models  are  implemented:  the 
nu'lti variate  normal  cumulative  distribution  function;  the 
Dirichlet  cumulative  distribution  function;  and  the  mul¬ 
tivariate  generalized  beta  cumulative  distribution  function. 
The  properties  and  the  derivation  of  this  latter  distribu¬ 
tion  are  presented  in  Appendix  A;  the  former  two 
distributions  are  well-known.  The  necessary  derivatives  of 
the  three  distributions  are  presented  in  Appendix  B. 
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The  scaling  transformations  of  the  coherence  phase  are 
proposed  to  be  static  and  are  therefore  incorporated  direc¬ 
tly  into  the  modelling  phase.  The  modelling  may  be  per¬ 
formed  in  one  of  three  metrics;  the  metric  of  the 
indifference  probabilities;  the  logodds  metric;  and  the  arc¬ 
sine  metric.  The  uses  of  the  logodds  and  the  arcsine 
metrics  are  mell-known  in  the  analysis  and  estimation  of 
probabilities  and  proportions  (e.g.,  Ncvick  and  Jackson, 
197h).  The  necessary  derivatives  for  these  transformations 
are  also  presented  in  Appendix  D. 

Once  the  estimates  have  been  calculated,  the  procedure 
returns  to  the  coherence  phase,  vhere  the  decision  makei  may 
accept  the  estimates  or  modify  the  data  for  furthei 
estimation.  A  general  discussion  of  the  entire  procedure  is 
presented  in  Section  5. 

In  general,  the  problem  may  be  defined  as  follows.  One 
has  a  multiattribute  decision  to  make  and  desires  to  assess 
the  utility  over  this  multidimensional  space.  We  will  let 
denote  the  attribute  vector.  We  will  assume  that  the 
attribute  space  is  continuous,  or  at  least  that  it  may  be 
adequately  approximated  by  a  continuous  space.  (This  assum¬ 
ption  is  imposed  by  the  choice  of  models.  If  a  suitable 


multivariate  discrete  probability  function  could  be 
postulated,  it  could  be  fit  into  this  framework  with  only  a 
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little  Bodification  in  the  nodel  estimation  phase.) 

The  elicitation  algorithm  requires  that  we  present  gam¬ 
bles  involving  specific  points  within  the  attribute  space; 
therefore,  the  decision  maker  must  first  be  asked  to 
deternine  these  points.  Several  restrictions  are  useful. 

First,  the  procedure  is  simplified  if  subsets  of  the 
points  Bay  be  chosen  so  that  the  subsets  are  convenient  con¬ 
ditional  sets.  The  subsets  are  convenient  if  the  con¬ 
ditional  models  for  the  subsets  are  simple  models.  Since  we 
are  modeling  the  utility  functions  by  cumulative  distribu¬ 
tion  functions,  this  convenience  criterion  requires  that  the 
conditional  models  be  tractable  cumulative  distribution 
functions.  Considering  the  models  that  we  have  selected, 
the  most  convenient  set  of  points  are  those  of  a  rectangular 
hypergrid.  This  allows  the  subsets  to  be  states  that  differ 
in  only  one  dimension,  and  the  conditional  models  to  t;e  sim¬ 
ple  cumulative  distribution  functions. 

This  restriction  also  allows  the  simples.t  method  for 
selecting  the  points  to  be  used.  The  decision  mjkei  merely 
aetermines  the  number  of  dimensions  in  the  problem  and  then 
selects  several  points  alonj  e.o  h  dimtn.sioii.  Thf  s*  p<)itits 
determine  the  rectangular  hypeijrid. 

This  is  not  a  substantial  restriction.  klttnjugh  it  i;, 
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reasonable  that  some  of  the  resulting  aultid imensiona 1 
points  may  be  improbable  or  difficult  for  the  decision  maker 
to  value,  the  model  for  the  utility  function  does  not 
require  that  every  point  in  the  hypergrid  be  involved  in  the 
elicitation  phase.  This  is  an  advantage  of  the  functional 
model  as  opposed  to  the  point  estimation  model,  such  as  the 
least-squares  procedure  of  the  CADA  Monitor  (Hovick,  Hamer, 
Libby,  Chen,  and  Woodworth,  19ti0) .  If  a  particular  point 
poses  a  difficulty,  the  deci?;ion  maker  may  simply  choose  to 
not  judge  any  gamble  triple  that  involves  it. 

Second,  we  requite  that  the  utility  function  Lc 
monotonically  increasing  in  all  dimensions.  Again,  this  is 
a  convenience  for  our  choice  of  models;  indeed,  the-  models 
impose  this  condition.  It  is,  hewevtt,  a  it-asonaMi 
restriction.  In  many  cases  where  this  restriction  is  t. ct 
ao't,  the  problem  may  be  redefined. 

For  example,  in  a  one-dimensional  problem  in  which  the 
utility  IS  high  in  the  middle  of  the  attribute  space  and 
fill".  off  tovaids  both  extremes,  such  a:,  rn  some  mednai 
s.tudtron'.  in  which  both  .i  h  i  p  h  d'l.age  and  <i  low  do'. age  hive 
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the  decision  maker  can  select  points  that  are  of  essentially 
minimum  and  maximum  value.  Thus  we  can  assume,  without  loss 
of  generality  that  the  utility  function  ranges  from  0  to  1. 

This  is  in  effect  defining  a  conditional  utility  func¬ 
tion.  The  point  where  all  dimensions  have  the  least  value 
is  assumed  to  have  value  0,  and  the  point  where  all 
dimensions  have  the  greatest  value  is  assumed  to  have  value 
1.  With  some  additional  information  or  assumptions,  we 
could  uncondit ionalize  the  resulting  utility  function;  we 
will  not,  however,  discuss  this  loint  further. 

Section  2.  The  Elicitation  Phase 

The  elicitation  phase  for  the  multiattribute  utility 
assessment  is  essentially  the  same  as  was  discussed  in  Chap¬ 
ter  II  and  implemented  in  the  CADA-19t!C  Monitoi  (Ncvick, 
tiamet,  I.ibby,  Chen,  and  Woodworth  1980).  There  are  two 
elicitation  algorithm;.;  t  )ie  Conditional  Ccherence  Procedure 
and  the  Regional  Coheience  Proceduie  (  Ncvick,  Chuang,  and 
OeKeyrel,  1979;  Novirk,  Hamei,  I.ibby,  Cht-n,  and  Woodworth, 
1  980).  There  air*  t  vn  entry  lormats:  direct  entry  (of  the 
indifference  probability)  and  "end;r-ii,"  (Novick,  19  80; 
Hovick,  Turner,  and  Novick,  1981).  In  addition,  the 
decision  malrer  ha;,  the  option  of  pas.'-.inj,  or  not  making,  a 
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judgment . 

In  both  the  elicitation  algorithms,  the  decision  maker 
is  presented  with  a  sequence  of  gamble  triples.  Each  triple 
consists  of  a  gamble  between  two  points  in  the  attribute 
space  and  a  "sure  thing"  point.  The  triples  are  chosen  so 
that  the  sure  thing  point  is  intermediate  in  utility 
relative  to  the  two  points  in  the  gamble  and  so  that  only 
one  dimension  in  the  attribute  space  is  varying  among  the 
three  points.  The  goal  is  the  probability  of  the  higher- 
valued  point  in  the  gamble  such  that  the  decision  maker  is 
indifferent  between  the  gamble  and  the  sure  thing. 

For  example,  suppose  that  we  have  three  points  in  the 
attribute  space,  ^  ,  and  in  order  of  preference.  The 
decision  maker  would  be  presented  with  a  choice 
(hypothetically)  between  obtaining  state  for  sure  and 
gambling  on  obtaining  state  .  with  probability  p  or  obtain¬ 
ing  state  with  probability  1-p.  Our  goal  is  to  elicit 
the  probability  p  such  that  the  decision  maker  is 
indifferent  in  this  choice. 

In  the  Conditional  Coherence  Procedure,  the  gamble 
triples  are  presented  in  sets,  wheie  only  one  dimension  of 
the  attribute  space  is  varying  in  each  set.  T)ie  [nocedure 
is  like  the  least-squares  procedure  of  the  CADA-1980 
Monitor,  except  that  we  are  considering  the  one-dimensional. 


conditional  utility  function  within  each  set.  After  judging 


each  set,  the  decision  maker  may  elect  to  review  the  judg¬ 
ments  of  that  set  and  correct  any  errors. 

The  conditional  sets,  as  they  assume  fixed  states  for 
all  but  one  attribute,  are  chosen  so  that  they  cover  the 
attribute  space.  The  decision  maker  may  elect  to  pass  on 
any  set.  Within  each  set,  the  gamble  triples  are  chosen  so 
that  the  three  states  are  adjacent  in  the  dimension  that  is 
varying . 

For  example,  suppose  that  the  decision  maker  has  chosen 
N  states,  0]^  ,  /  along  a  single  attribute  dimension 
for  elicitation.  The  decision  maker  would  be  presented  with 
a  choice  between  a  state  for  sure  and  a  gamble  involving 
states  0^^^  and  ,  where  i  is  some  integer  between  1  and 
H. 

The  Regional  Coherence  Procedure  differs  only  slightly 
from  the  above.  As  in  the  Conditional  Coherence  Procedure, 
the  gamble  triples  are  presented  in  conditional  sets,  where 
the  states  of  all  but  one  attribute  are  fixed.  Again,  the 
adjacent  gamble  triples  are  used. 

The  triples  are  presented  in  pairs,  with  each  pair 
involving  only  four  states.  After  each  pair  of  adjacent 
triples  is  presented,  the  two  other  triples  from  the  four 
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states  are  presented  with  the  implied  indifference 

probabilities.  For  example,  let  ‘',0,0,  and  j  be  four 

a  b  c  d 

adjacent  states  in  a  uniattribute  assessment.  The  decision 

maker  would  be  presented  first  with  the  two  choices: 

for  sure  gamble 

F  1-p 


and  might  respond  with  probabilities  p^ 
tively,  that  make  the  choice  indifferent. 


respec- 


Based  on  this  information,  coherent  indifference 

probabilities  may  be  calculated  for  two  other  choices: 

for  sure  gamble 

F  1-p 


This  is  accomplished  by  examining  the  conditional  utility 
function  over  those  four  states.  Since  two  utilities  are 
fixed  (at  0  and  1),  only  two  gamble  triples  are  needed  to 
determine  the  conditional  utility  function.  The  decision 
maker  may  then  accept  the  implied  indifference  probabilities 
or  correct  any  of  them.  When  they  are  acceptable,  another 
pair  of  adjacent  triples  from  the  same  conditional  set  is 
presented . 


The  above  procedure  is  like  the  procedure  of  the  same 
name  in  the  CADA-  1980  flonitor.  When  all  the  pairs  from  one 


131 


conditional  set  have  been  presented,  the  decision  maker  may 
revieB  the  judgments  and  proceed  on  to  the  next  set. 

The  entry  formats  are  available  in  both  of  the  above 
procedures.  The  direct  entry  format  allows  the  decision 
maker  to  specify  the  indifference  probability  for  the 
presented  gamble  triple.  The  "ends-in"  format  allows  the 
decision  maker  to  respond  with  a  preference  for  the  sure 
thing,  a  preference  for  the  gamble,  or  indifference.  When 
the  decision  maker  is  indifferent,  another  gamble  triple  is 
presented . 

For  example,  suppose  that  the  decision  maker  has  chosen 
states  »  ^nd  ,  in  order  of  preference,  for 
elicitation  in  a  uniattribute  decision  problem.  In  the 
direct  entry  format,  the  decision  maker  would  be  presented 
with  the  following  choice: 

For  Sure  Gamble  F  that  makes 

p  1-p  you  indifferent 

1  "i  +  l 

The  decision  maker  would  enter  the  probability  for  the  gam¬ 
ble  that  would  make  the  choice  between  the  gamble  and  the 
for-sure  state  indifferent. 

In  the  "ends-in"  format,  the  decision  maker  is 
presented  with  a  probability  for  the  gamble  as  well  as  the 
gamble  triple.  The  probability  is  initially  either  0.1  or 
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0.9.  For  example,  the  decision  maker  night  be  presented 
with  the  following  choice: 


—  • 

-  - 

Option : 

I 

I 

I 

P  ^i+1 

I 

0. 

Indifferent 

I  For  sure  0. 

Gamble 

I 

1. 

For  sure 

I  ^ 

I 

’-E 

I 

I 

2. 

3. 

Gamble 

Restart 

Hhich  would  you 

prefer  if 

the  p 

— 

10? 

The  response  of  the  decision  maker  determines  whether  the 
indifference  probability  is  higher  than,  lower  than,  or 
equal  to  the  presented  probability.  The  next  probability  to 
be  presented  is  calculated  to  be  near  the  opposite  end  of 
the  resulting  interval. 

For  example,  suppose  that  the  presented  probability  is 
0.1  and  the  decision  maker  prefers  the  sure  thing.  Thus,  we 
know  that  the  indifference  probability  is  in  the  interval 
(0.1,  1.0).  The  next  probability  is  calculated  to  be  near 
the  end  of  the  interval  opposite  to  the  presented 
probability,  or  0.9.  If  the  decision  maker  then  prefers  the 
gamble,  then  we  know  that  the  indifference  probability  is  in 
the  interval  (0.  1,0.9).  This  sequence  continues  until  the 
decision  maker  responds  with  indifference  or  until  the 
interval  becomes  insignificantly  small;  this  threshold  is 
set  to  0.05.  In  this  latter  case,  the  middle  of  the  inter¬ 
val  is  selected. 


In  both  options,  the  decision  maker  may  avoid  judging 
the  gamble  triple.  In  the  "ends-in"  option,  the  decision 
maker  may  also  elect  to  begin  the  questioning  for  the 
current  gamble  triple  again. 

Section  3.  The  Coherence  Phase 

In  actuality,  the  previous  section  described  the  itera¬ 
tion  between  the  elicitation  phase  and  the  coherence  phase. 
In  the  Conditional  Coherence  Procedure,  coherence  may  be 
checked  after  each  conditional  set  of  gamble  triples  is 
presented.  In  general,  however,  there  will  be  insufficient 
data  to  make  initial  utility  estimates;  thus,  the  coherence 
checking  involves  only  the  review  of  the  assessed 
indifference  probabilities. 

In  the  Regional  Coherence  Procedure,  coherence  is  chec¬ 
ked  after  each  pair  of  gamble  triples  is  presented.  There 
is  generally  insufficient  data  to  make  utility  estimates  for 
the  entire  conditional  set,  but  it  is  possible  to  calculate 
the  indifference  probabilities  for  gambles  in  the  region. 

The  rest  of  the  multiattribute  utility  assessment 
procedure  is  primarily  an  iteration  between  the  coherence 
phase  and  the  modelling  phase.  After  the  parameters  of  the 
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model  for  the  utility  function  have  been  estimated,  the 
implied  indifference  probabilities  are  presented  along  with 
the  assessed  indifference  probabilities.  The  decision  maker 
may  decide  to  accept  the  fit,  modify  any  of  the  assessed 
indifference  probabilities,  or  delete  any  of  the  gamble 
triples  from  consideration. 

The  indifference  probabilities,  both  assessed  and 
implied,  are  presented  by  conditional  set.  The  difference 
between  the  two,  in  the  selected  metric,  is  shown,  as  are 
the  states  involved  in  the  gamble  triple. 

Optionally,  the  decision  maker  may  view  the  estimates 
of  the  parameters  of  the  chosen  model,  the  calculated 
utilities  of  selected  points  in  the  attribute  space,  or  a 
graph  of  the  utility  function.  The  decision  maker  may  also 
view  the  implied  indifference  probabilities  of  gambles  not 
used  in  the  modelling  phase. 

If  there  are  any  modifications  to  the  set  of  gamble 
triples  and  associated  indifference  probabilities,  the 
modelling  phase  is  entered  again.  This  iteration  continues 
until  the  utility  function  is  acceptable  to  the  decision 


maker . 
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Section  4.  The  Modelling  Phase 


The  modelling  phase  is  an  iterative,  non-linear  least- 
squares  algorithm.  The  objective  function 

(VII.4.1)  F  =  L'[m(pg)  -m(pQ)]^ 

is  the  sum  of  squared  deviations  of  the  assessed 
indifference  probabilities  from  the  implied  indifference 
probabilities  in  the  chosen  metric.  The  algorithm  attempts 
to  find  the  minimum  of  equation  (¥11.4.1)  with  respect  to 
the  parameters  of  the  chosen  model  for  the  utilities.  There 
are  three  metrics  and  three  models  from  which  to  chose. 


The  problem  is  to  solve  for  the  roots  of  the  system  of 
first-order  derivatives  of  equation  (¥11.4.1).  The  Newton- 
Raphson  method  is  used  because  it  is  stable  and  the  neces¬ 
sary  second-order  derivatives  are  algebraically  obtainable 
(although  extremely  complex) .  The  new  parameter  estimates 
at  each  iteration  are  calculated  by 


(¥11.4.2) 


r).,  =  n-  “  H  g. 
-1+1  1  1^1 


where  ri^  is  the  vector  of  parameter  estimates  at  iteration 
i*  3  is  the  gradient  vector,  the  first  derivatives,  and 
is  the  Hessian  matrix,  the  inverse  of  the  matrix  of  second- 
order  derivatives.  The  gradient  vector  and  the  Hessian 
matrix  of  equation  (¥11.4.1)  are  presented  in  Appendix  B. 
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The  calculations  of  the  Hessian  latrix  and  the  gradient 
vector  are  tedious  and  time-consuaing .  Therefore,  a 
subiteration  is  also  used.  The  correction  of  equation 
(VII. 4. 2)  is  applied  until  the  ainiauB  is  overshot;  this 
last  correction  is  then  rescinded.  The  correction  is 
repeatedly  halved,  and  applied  (unless  it  overshoots  the 
ainiaum) ,  until  the  correction  is  negligible  (on  the  order 
of  0.00001).  The  iteration  continues  with  the  recalculation 
of  the  gradient  vector  and  the  Hessian  aatrix-  The  itera¬ 
tion  terminates  when  the  sum  of  squared  deviations  differs 
from  that  of  the  previous  iteration  by  a  negligible  amount 
(on  the  order  of  0.00001). 

Chec)cs  are  made  to  insure  that  the  parameter  estimates 
remain  within  valid  boundaries.  If  they  exceed  the  boun¬ 
daries,  the  correction  is  rescinded  and  halved,  and  the 
iteration  continues.  Note  that  the  models  insure  that  the 
utilities  are  monotone,  so  this  need  not  be  checked.  To 
protect  against  a  very  slow  convergence,  the  iterations  are 
presented  in  sets  of  ten;  the  decision  maker  may  terminate 
the  estimation  phase  at  the  end  of  any  set. 

One  additional  problem  aay  arise.  If  the  utility 
estimates  become  too  close,  the  numerical  algorithm  may 
become  unstable.  This  may  be  observed  by  examining  the 
derivatives  used  to  calculate  the  improvements  in  equation 
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(VII.4.2).  If  the  utility  estimates  used  in  any  gamble 
triple  to  calculate  the  derivatives  become  essentially  egual 
(e.g.,  within  .03),  that  gamble  triple  is  not  used  in  that 
iteration  of  the  modelling  phase. 

The  metrics  that  are  available  are  the  indifference 
probability  metric,  the  logodds  metric,  and  the  arcsine- 
square-root  metric.  The  indifference  probability  metric 
implies  the  identity  transformation: 

(V II.  4  .  3)  m(p)  -  p  . 

The  logodds  metric 

(VII.  4.  U)  m(p)  -  IcK) 

and  the  arcsine-squaro-rcot  metric 

{VII.4.5)  ni(p)  =  arcsin(/li‘) 

are  widely  used  in  Educational  and  Psychological  research 
(Novick  and  Jackson,  1974)  for  transforming  probabilities  to 
obtain  well-behaved  quantities.  The  sensitivity  of  the 
solution  to  these  metrics  has  been  researched  (Mayekawa, 
1981)  and  found  to  be  insignificant.  They  are  made 
available  for  completeness.  The  necessary  derivative;,  of 
these  transformations  are  presented  in  Appendix  b. 

The  three  models  that  are  available  are  three  mul- 


tivariate  cumulative  distribution  functions:  the  mul¬ 
tivariate  normal,  the  Dirichlet,  and  the  multivariate- 
generali2ed  beta.  The  normal  and  the  Dirichlet 
distributions  are  vel l-knomn .  Their  univariate 
counterparts,  the  univariate  normal  and  the  standard  beta 
distributions,  have  been  used  to  model  uniattribute  utility 
functions  (  Novich  and  Lindley,  1980;  Hcvick,  Hamer,  Libby, 
Chen,  and  Woodworth,  1980;  Chen  and  Novick,  1981), 

The  generalized  beta  distribution  was  developed 
specifically  for  this  application.  The  marginal 
distributions  reproduce  the  same  functional  form,  as  do  the 
conditional  distributions  with  all  but  one  dimension  fixed. 
The  univariate  counterpart  is  a  three-parameter  beta -like 
distribution.  The  standard  beta  distribution  can  be  shown 
to  be  a  special  case.  The  derivation  of  this  distribution, 
as  well  as  that  of  a  companion  distribution,  are  presented 
in  Appendix  A. 

Because  of  the  theory  of  conditional  expected  utility 
and  the  modelling  of  the  utilities  by  cumulative  distribu¬ 
tion  functions,  we  find  the  estimation  may  be  greatly  sim¬ 
plified.  We  need  not  work  directly  with  the  multivariate 
cumulative  distribution  function.  Ey  defining  the  con¬ 
ditional  state  sets  as  we  have,  we  need  only  work  with  th( 
corresponding  conditional  utility  functions. 


1 


Each  inplied  probability  P,  in  equation  (VII. 4.1)  i  ■ 

1  jK 

calculated  as  a  conditional  utility,  assuming  that  the  three 
states  in  the  gamble  triple  are  all  that  matter.  The  cal¬ 
culation  requires  a  utility  for  each  state. 


(VII. 4. 6) 


ijk 


U(’)  -  u(o  . ) 


but  the  utilities  may  be  from  any  conditional  utility  func¬ 
tion.  They  may  be  from  the  multiattt ibute  utility  function 
(every  utility  function  is  conditional).  They  may  also  be 
from  the  conditional  utility  function  over  the  conditional 
set  of  states  to  which  the  gamble  triple  belongs.  It  is 
this  latter  approach  that  we  take  here. 

Because  of  the  manner  in  which  we  have  defined  our  con¬ 
ditional  set  of  states,  these  conditional  utility  functions 
are  uniattribute.  Because  of  the  models  that  we  have  chosen 
to  use,  they  are  univariate  cumulative  distribution  func¬ 
tions.  The  parameters  of  these  conditional  models  are  func¬ 
tions  of  the  parameters  of  the  multiattribute  model.  Thus, 
we  may  find  the  estimates  of  the  parameters  of  the  multiat¬ 
tribute  utility  function  directly  using  this  least-squares 
procedure.  The  necessary  first-  and  second-order 


derivatives  of  the  three  models  are  presented  in  Appendix  B. 
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reduces  the  nuaber  of  paranietets  in  the  iroel.  hhili-  Jixii 
paraaeters  ijenerally  lestiict  the  flexiLility  <>t  »  h.-  lenjit- 
ing  fit,  the  models  were  selected  aith  this  in  itit.d,  aic 
their  use  has  been  ju.stilied  m  t  lu-  lit.-iituio.  *,  t  .  x 
probability  den ;;  1 1  y  function,  x  i  t  ji.it  a  ,  |  a  ;  >  lO 

flexibility,  was  devtlopoii  sjo  citKiliy  fii  tii, 

application. 

The  model.s  that  were  [loposfd  in  this  ch(i(tc;  hav.  ■ 
significant  disadvantaje  com[aif  d  to  th.'  tied.’,  [  ;  p  '  .  c  ;; 
Chapter  V .  Recall  that  in  c  h.ipt  e  i  V  ,  x.  i  i  o  d  t ; 

extension  of  th<‘  Novick-Lindl.-y  utility  (•'.■'bi.'I.*  pioi.  iui> 
based  on  result:;  from  mu  1 1  id  i  mens  i  on  a  1  si  a  1 1  n  j  and  lono'.nt 
measurement.  The  advantage  vith  that  aodel  i;  t h.  pot.ntial 
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little  to  the  ov«‘rdll  m  u  1 1  i  a  1 1  r  :  t  u  t  e  utility  t  u  - 1  i  c  .  W>' 

iruld  thei.  Bd  I  finalize  out  this  diBen'iion  and  h  iv-  i  uiaiflei 

utility  f  u  n  1  ■  t  1  Cl  a  . 
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tion  would  tie  a  convenient  toia  f.ai  i  n  v  e;  t  i  a  a  t  i  (i  j  thi 


t  yi  . 
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of  dimension  reduction  because  linear  transformations 
reproduce  the  same  functional  form.  We  could  determine- 
other  suitable  distributions  for  known  transformations,  as 
well.  The  difficulty  arises  when  we  are  net  willing  or  able 
to  .specify  the  functional  form  of  the  transformation. 

Some  of  the  u.sual  applications  for  the  multiattribute 
utility  assessment  procedure  may  be  suitable  tor  the  above 
type  of  analyr.is.  ;;uppose  that  we  have  an  attribute  to  be 
u.s€!d  in  vi  decision.  In  a  dec  is.  ion  with  risk,  wf  will  not 
know  the  value  of  thi.s  attribute  when  we  must  make  thr- 
decision;  we  oay,  howevei,  have  a  prediction  equation  for  it 
ui'ing  several  available  mear.urts.  For  example,  we  may  wish 
to  decide  to  accept  or  t  eject  ,i  .graduate  .school  applicant 
based  on  first-year  gr-ides.  predicted  by  verbal  and. 
quantitative  Graduate  Record  Examination  score.s. 

If  the  predict  i.jn  e- qua t  ion  i.s  linear,  as  they  usually 
are,  and  if  we  are  satisfied  with  a  cumulative  normal 
distribution  function  model  for  the  utilities  over  the 
attribute  of  first-year  -giader.,  we  should  be  able  to 
determine  a  two-dimensional  utility  tuncticn  ovei  the  GiJE 
scores.  This  line  of  itse'arch  is  ttyond  the  ^.cope  of  this 
['ijs?!  -ind  i.*".  raentioii'-i)  heie  only  to  iiid;r.»te  diiertions  tli.it 


it  may  take. 


It  will  be  1  n  v  <?:.  t  1  qa  t  ed  in  a  separate  -.tudy. 


h  2^®  Generalized  Pet a  and  F  Distributions 


Section  1.  Intcodaction 

In  developing  the  nultiattr ibu te  utility  function 
analysis  based  on  cumulative  distribution  functions,  it  was 
necessary  to  derive  a  new  probability  density  function  of 
multiple  dimensions.  It  may  be  that  the  functions  presented 
here  are  two  of  the  "many  possible  forms  that  are  not  in  use 
at  present  and  are  not  likely  to  have  useful  applications" 
(Johnson  and  Kotz,  1972)  . 

In  the  following  sections,  two  multivariate  probability 
functions  are  derived.  They  are  both  based  on 
generalizations  of  comnion  distributions,  namely  the  beta 
distribution  and  Snedecor's  F  distribution,  and  they  are 
simple  transformations  of  each  other.  The  multivariate 
generalized  beta  distribution  is  discussed  in  Section  2  and 
the  multivariate  generalized  F  distribution  is  discussed  in 
Section  3. 

The  moments  of  the  generalized  beta  distribution  are 
not  computable  in  closed  form.  Approximations  may  be  c.jI- 
culated  from  the  moments  of  the  generalized  F  distribution. 
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Both  the  approximate  moaents  of  the  generalized  beta 
distribution  and  the  exact  Doments  of  the  generalized  F 
distribution  are  presented  in  Section  4. 


Section  2.  The  Generalized  Beta  Distribution 

The  generalized  beta  distribution  is  a  simple  extension 
trom  the  common  beta  distribution.  It  uses  general  gamma 
random  variates  instead  of  the  chi-square  random  variates 
used  in  the  derivation  of  the  common  beta  distribution. 

The  impetus  for  the  generalized  beta  distribution  is  as 
follows.  For  a  model  of  a  multiattribute  utility  function, 
we  wanted  a  cumulative  distribution  function  that  had  the 
same  degree  of  flexibility  in  form  that  the  beta  distribu¬ 
tion  provided.  Although  the  Dirichlet  distribution  is  a 
multivariate  generalization  of  the  beta  distribution,  it  has 
the  restriction  to  a  lower-dimensional  simplex  that  is 
undesirable  in  some  cases. 

In  particular,  we  wanted  a  multivariate  distribution 
having  positive  probability  on  the  full  (0,1)  hypercube, 
marginal  distributions  that  reproduce  the  same 
distributional  form,  and  "nice"  conditional  distributions. 
We  were  looking  for  a  multivariate  distribution  whose 


univariate  marginal  distributions  were  beta  distributions 
and  which  had  some  sort  of  standardized  univariate  con¬ 
ditional  distributions  that  were  beta  distributions,  much 
like  we  have  in  the  Dirichlet  distribution  and  the  normal 
distribution. 

We  discovered  a  multivariate  distribution  with 
reproducing  marginal  distributions,  univariate  marginal 
distributions  that  are  a  generalization  of  the  beta 
distribution,  and  univariate  conditional  distributions  that 
are  the  same  generalization  of  the  beta  distribution.  He 
are  calling  this  distribution  a  multivariate  generalized 
beta  distribution  of  the  first  kind. 

Let  Xq,  X ...,  X ^  be  distributed  as  independent  gamma 
random  variates  with  parameters  and  ,  ,  i  =  0,  ...,  r, 
respectively.  The  joint  distribution  of  ,  X^,  ...,  X  is 
given  by 


{A . 2.  1) 


1 


Let  =  I„,  and  Y  =  X  /(1-X  )  for  i  =  1,  ...,  r.  This 

0  0  ill 

gives  the  inverse  transformation  X^^  =  ,  and  X 

Y^Y^/(1+Y^)  for  i  =  1,  t.  The  Jacobian  for  this 

distribution  is  given  by 
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(A. 2. 2)  J[X->Y]  = 


1-y- 


l-y. 


1-y, 


2  0 


(i-y^) 


Thus,  the  joint  distribution  of  ,  Y^ ,  Y^  is  given  by 


(A. 2. 3)  P(yo/ 


.Y^)  = 


^  e-o^’o 

'■■-1  ..  /polls' 


i  U-i'i, 


r  r  I.‘  .  i  ,y„y  .  \  1 

*  1__L_  iP^ 
i=i'Lr(.x^)U-yi/ 

*  r  r  r  ,  ,  \  - 2l 

*  .  y  n  (l-y  . ) 

-  0  i=l  1  J  U.  , 

/  y  •  \  1  - 1 

/  .  u  -  r  u  .  /  1  \  I  i.  1 

il-v'  l-y) 

=  ri=0  1/  ^'0  i=l  1  ^i' 


^I  =  0‘  ('‘i) 


r  /  ^i 

ro^^i  =  i^i(wll 


'3r  £ 


■i  =  0  ‘■‘i'^o"''  '''i=l  *'il^l-y^,j 


y 


^',1 


V  . 
■  1 


where  yJ >  represents  the 

i  =  0  "I  i==l  11'  ^ 

probability  density  function  of  a  gamma-distributed  random 

Thus  the 

marginal  distribution  of  Y,  ,  ...,  Y^,  is  given  by 


r  z  (  Y^\ 

variate  of  parameters  .  ^ .  and  »„  +  .':  ^ - ,< 

^  1-0  1  0  i  =  i  1  U-yv/ 
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'I  r-l\a  (  1 

i-A^  1+;:^  ^  A.  (  '^V'i-O'^i 

1-0  1  =  1  1 


where 


j.  u  , 

r  1-  i 
/  w  ()  w 

*  I  _r _ £ 

J  fl+w  J‘'i  =  o'"i 

0  I 


i=l  1  \i-yjj 


Therefore,  the  marginal  distribution  is  given  by 


(A. 2, 7)  p(y^, 


^r-l 


/ \  1“  i  r,  ct ,  /  ■(* i"  1  \  ^ 

)=  liiioli/  i=i  L  i^ 


,i-y,Z, 


since  the  distribution  of  in  equation  (A. 2. 6)  is  a  beta 

of  the  second  kind  and  has  a  constant  of  proportionality 
-L 

K  la  ,  ,  E  a  .  )  - 
1  1  =  0  1 

From  equation  (A. 2. 7)  we  can  see  that  the  multivariate 
generalized  beta  distribution  has  the  convenient  property  of 
reproduction  of  form;  any  subset  of  the  variates  again  form 
a  multivariate  generalized  beta  distribution.  Indeed,  the 


univariate  marginal  distribution  is  given  by 


{A. 2. 8)  p(y^)  = 


a  .  -  J 

r(aQ+a^)  U--y 

1  i\l-y,;i 


thus  reproducing  the  generalized  beta  fora. 

Note  that  if  Y  is  distributed  as  a  standard  l^ctd  riadom 
variate  of  the  first  kind,  with  paraaeters  a  and  ,i , 


(A. 2. 9)  P{y)  = 


r  (a+ 3 )  ..ci-l  , ,  ,  ii- 1 


r (a) r (6) 


(I'y) 


r (g+g) 
r  (a)  r (3) 


0  ■  y  ■  1 


Hence,  the  standard  beta  distribution  of  the  first  kind  is 
the  generalized  beta  distribution  with  parametrr;  ,  ,  and 
A  =  1, 


Conditional  distributions  may  be  found  in  :.  v<La.  way.s. 
One  aay  be  found  by  observing  that 


Let  Yj. 


1=1  i\l-yj 


then  .-y^ 


r  Vl-Yj-' 


'1  =  1  '  1  \l-y:, 


■'r  ir^y 


1  '/  ' 

'  1  : 


‘1  ■-li-yy 


Thus 


(A. 2. 11)  p(y^  • ■ '^r-i^ 


iJrA 

.,  l,A  -l 


'r'- 


ty,-  / 


*  *  *  ,  - 1 

( i-y ,  )'i  =  o  1  " 


*  H  *.  .1  -  1 

^  '  j 


y  ■■  .  > 

I  r  1  -  'j  1 


*  ★  * 

^  y  j  < 


Hence,  Y^.  |Y^,...,T^_^  is  distributed  as  a  ijeneralized 

r  -  I  *  *  * 

beta  randon  variate  with  paraeeters  and  =  1, 

i.e.,  a  standard  beta  randoe  variate  of  the  first  kind. 

*  *  * 

Note  that  the  eoeents  of  Y^  I  Y^  - - • dependent 

on  Y  ,  ...»  Y  , ,  and  that  the  joint  distribution  of  the  r 

1  r-  1 

conditional  random  variates  thus  defined  are  constrained  so 


152 


(A. 2. 13)  P(y, 


V"  i  =  0  1/ 


"  fr-1 

‘  ’'{^•x  =  0  '‘x 


'l  +  Vr 


★  ★ 

The  distribution  of  is  thus  a  beta  distribution  of  the 

second  kind.  This  is  a  special  case  of  the  distribution 

discussed  in  Section  3,  the  generalized  F  distribution,  of 

this  Appendix  A.  Note  that  =  Y^,  /(1-Y^  ),  given 

Y^  ,  :  this  relationship  is  developed  further  in 

*  * 

Section  3  as  well.  Also  note  that  the  moiaents  of  Y^  , 
given  Y^^  ,  .  .  .  ,  Y^.  ,  are  not  dependent  on  Y^  ,  .  .  .  ,  Y^  _  ^  ,  but 
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that  the  expected  value  of  fj./ is  linear  in  the  odds 
ratios  of  the  conditioning  variates- 

Another  conditional  distribution  may  be  derived  by 
observing  that 


i 


r'-  1 

1  -(! 


Hence 


,  Yj,  =  Yj.  I  Yji  •  •  '  '  I  distributed  as  a  generalized 


beta  random  variate  with  parameters  ^  ^ 


;  ,  and 


1  =  0  ^ 


Except  for  the  result  that  the  moments  of  the 
generalized  beta  distribution  are  not  obtainable  in  closed 
form,  this  conditional  distribution  is  the  most  useful  of 
the  three.  It  relates  directly  to  Y^,  not  to  the  odds  ratio 
of  Yj-.  It  is  the  same  distributional  form  as  the  mul¬ 
tivariate  and  marginal  distributions.  Finally,  the  moments 

are  likely  to  be  dependent  on  Y^^ ,  ...,  Y^.  ,  as  odds  ratios, 

★ 

through  the  parameter  ■  . 


The  fact  that  the  moments  are  not  obtainable  in  closed 
form  is  a  drawback  to  its  usefulness.  Me  may,  however, 
obtain  approximations  to  the  moments,  using  the  companion 


distribution  discussed  in  Section  3. 


The  m o B e ri  t  s  of  Loth 


distributions  are  discussed  further  in  Section  4. 


Section  3.  The  Generalized  F  Distribution 

The  generalized  F  distribution  is  a  simple  generaliza¬ 
tion  of  the  standard,  Snedecor's  F  distribution.  It  may  be 
derived  from  an  underlying  gamma  distribution  like  the  stan¬ 
dard  F  distribution  is  derived  from  the  chi-sguare 
distribution.  Note  that  the  chi-square  distribution  is  a 
special  case  of  the  gamma  distribution.  The  generalized  F 
distribution  may  also  be  derived  as  a  transformation  of  the 
generalized  beta  distribution,  in  much  the  same  way  as  the 
standard  F  distribution  may  be  derived  as  a  transformation 
from  the  standard  beta  distribution.  In  fact,  it  was 
derived  initially  this  way  by  this  author. 

Both  derivations  are  presented  below,  with  the  deriva¬ 
tion  from  the  gamma  random  variates  first.  ks  in  t he 
previous  section,  the  development  is  in  terms  of  the  mul¬ 
tivariate  distribution. 

Let  X,,  X  ,  X  L<  distributed  as  independent  gamma 
random  variates  with  parameters  and  ,  i=0,  1,  ...,  i 
respectively .  The  joint  d  i  ;;tr  i  bu  t  icn  of  x,  ,  X,,  ...,  X,  is 
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given  by 


iA.  3.1)  p  (Xq,  .  ,x^.; 


r-  I 

r  ‘  .  1 

,  1 

i-o'jJTITr 


u 

X 

1 


Let  Zq  =  Xq ,  and  for  i=1,  ...,  r.  This  gives  the 

inverse  transf ormaton  Xq  =  Zq ,  and  =  Zq*Z^  for  i= 1 , 
r.  The  Jacobian  for  this  transformation  is  given  by 


(A. 3. 2)  J[X'-Z]  = 


1 

0 


"1 

"0 


0  0  0 


...  0 

I 


Thus,  the  joint  distribution  of  Z  ,  Z  ,  . . . ,  Z  is  given  by 


(A. 3. 3)  p(Zq,2^,  .  .  .  ,z^)  = 


'’O  °  ‘o'^  """O^O 

z„  e 


K.q)  0 


1  U  I 


I  .  1  1 

‘  U^o'-^iy  '''0  °''i=0L-  i 

..  r 

r  r  ,  r  ‘•i=n‘i 

ilo' 


1  =  0  '  i  ' '  o’  ^  J  1  '  1 


where  u  z  .t  ,  +  v  ^  represents  the  probability  uensity 

\i  =  0  1  0  i^  J  ‘i  ij 
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function  of  a  gamma-distributed  random  variate  with 

r  r 

parameters  and  ;„+  I  ■  z  .  Thus  the  marginal  distribu- 

1=0^  0i=iii 

tion  of  Z^,  Z^  is  given  by 


(A.  3.  4)  p  (  7.^  ,  .  .  .  , 


(  ^ 


where  A.  =  ; .  /  as  in  Section  2.  This  is  the  multivariate 

1  1  0 

generalized  F  distribution. 

Marginal  distributions  nay  be  found  by  integration,  so 

that 


(A. 3. 5)  p(7^<. 


•r-  1' 


r-1 
i  =  0 


r-1 
1  =  1 


,1.-1 

1 


r-1 

1  =  0  1 


I  "^-i=i 


z  , 
1 


r-1 

„  a  ■ 

1  =  0  1 


Z 

1 


and 


(  A  .  j  .  6  )  p  (  z,  ) 


1 1 
1  1 


•1 


-r-Ki-rr  fj7V,7:  V'i  " 

'  1  1  ’ 

I 


Thus,  the  multivariate  generalized  F  distribution  has  the 
convenient  reproduction  of  distributional  form  in  any  subset 
marginalization,  including  the  univariate  marginal 


d i s  t  r i hu  t i on  s . 
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Note  that  the  standard,  Snedecor's  F  distribution  is  a 
special  case  of  this  generalized  F  distribution.  if  z  is 
distributed  as  a  standard  F  random  variate,  its  probability 
density  function  may  be  written 


(A. 3. 7)  p(z)  = 


■■■  i  k  k 
9  ^12  ^2 


R 


1  k 

2  2 


4  ik  -1 

k  /k  ^  z  21 
k^/K  , 

- J- - - - -  0  z  . 

(k^/k^)  z  '  2^l'*'2^2 


Thus,  it  is  a  generalized  F  random  variate  with  parameters 

Note  also  that  the  beta  distribution  of  the  second  kind 
is  a  special  case  of  the  generalized  F  distribution,  with 
=  1.  In  addition,  the  multivariate  F  distribution  and  the 
®^lfivariate  inverted  beta  distribution  mentioned  by  Johnson 
and  Kotz  (1972)  are  special  cases  of  the  multivariate 
generalized  F  distribution  in  the  same  way  as  are  the  stan¬ 
dard  F  distribution  and  the  beta  distribution  of  the  second 
kind  of  the  univariate  generalized  F  distribution. 

The  generalized  F  distribution  may  also  be  derived  from 
the  generalized  beta  distribution  as  follows.  Let  Y  be 
distributed  as  a  generalized  beta  random  variate  with 
parameters  a  ,  /,  ,  and  a  .  Let  Z  =  Y/(l-Y)  ;  then  Z  = 
(l-Yj-^  ,y  and 
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(A.  3  .  8)  p  (z) 


!’  (g  +  ii) 

(  )  r  ( ;? ) 


,  a  a- 1 
X  Z 

[1  + 


0  <  z  , 


which  is  the  probability  density  function  of  a  generalized  F 
random  variate  with  parameters  a  ,  i-.  ,  and  X  .  The  sane 
transformation  applies  in  the  multivariate  case  as  may  be 
seen  by  comparing  (A-2.5)  and  (A-3.U). 


Conditional  distributions  may  be  found  in  ways  similar 
to  those  presented  in  Section  2.  If  we  define 


(A. 3. 9)  z, 


X  z 
r  r 


1  +E 


r  1 

,  X  .  z . 
1=1  1  1 


we  find  that  Z^.  is  identical  in  distribution  to  of 

Section  2.  Similarly,  if  we"  define 


(A. 3. 10)  z^ 


z 

r  r _ 

1  +  •  z  . 

1  =  1  1  1 


we  find  that  Z  is  identical  in  distribution  to  Y 

r  r 

★ 

Lastly,  we  may  find  may  the  distribution  of  - 

Z ^  I  Z , Z^_ ^  is  that  of  a  generalized  F  random  variate 
with  parameter  .i,,  and 


r-  1 

1  +  '  '  : »  z  . 

1  =  1  1  1 


(A. 3. 11)  > 
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^  * 

Note  that  Z  is  a  transformation  of  Y  of  Section  2  such 
r 

that  Zj-  =  Y^.  /  (1-Y^.  )  . 

The  moments  of  the  generalized  F  distribution  are 
algebraically  calculable,  and  are  presented  in  the  next  sec¬ 
tion. 


Section  4.  The  Moments  of  the  Distributions 

In  this  section  we  discuss  the  moments  of  the 
generalized  beta  distribution  and  of  the  generalized  F 
distribution.  The  moments  of  the  latter  are  algebraically 
calculable,  whereas  those  of  the  former  are  not.  Ue  will 
derive  the  algebraic  forms  of  the  moments  for  the 
generalized  F  distribution  first,  and  then  derive 
approximations  for  the  moments  of  the  generalized  beta 
distribution  from  them  using  Taylor's  series  expansion  of 
the  transformation  from  the  generalized  F  distribution  to 
the  generalized  beta  distribution. 

Let  Z  be  distributed  as  a  generalized  F  random  variate 
with  parameters  and  '  ; 

(A.  4.1)  p(z)  =  -ilil-liii -  - ,  O^z 

r  { X  ):•(.•! )  ( 1  +  X  z  ]  '*  •' 
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The  t-th  moment  about  the  origin  is  given  by 


(A.  4.  2)  f, 


00 
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r  ( I  + ». ) 
r (a)  r  (B) 


a  a+t-1 
\  2 


0  Z 


r  (g+t)  r  (B-t) 
!'  {  g  )  r  (  B  )  X 


For  t  >  g,  the  moments  are  infinite.  Thus,  the  mean  p  , 
~  2 

variance  ,  and  skevness  of  this  distribution  are  given 
by 

( A .  4 . 3 )  V  -  -f—' — TCI  '  '  6  >  1 

2  (d-1)  A 
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2 

2 


a (g  +  B-l) _ 

(B-1) (B-2) 


a (6a (g-1) +e (g-2) +1) 
(K-l)  ^(B-2)  (B-1) X^ 


Other  central  moments  may  be  found  in  a  similar  manner,  by 
expanding  to  a  function  of  the  moments  about  the  origin  and 
using  (A. 4. 2).  These  three  are  all  that  are  used  in  the 
approximations  belov. 


Since  the  moments  of  the  generalized  beta  distribution 
are  not  algebraically  calculable,  we  now  present  some 
approximations.  The  approximations  are  based  on  the  trans¬ 
formations  from  the  generalized  F  distribution  to  the 
generalized  beta  distribution  and  Taylor's  series  expansion 


of  it . 


Suppose  we  have  a  random  variate  Z  that  hai;  a 
generalized  F  distribution-  Then  the  moments  of  a  Landom 
variate  Y  =  (Z)  may  be  found  if  the  transformation  ,  (.) 
has  derivatives  to  all  degrees  at  least  in  a  interval  about 
some  point  used  in  the  expansion,  in  this  case  the  mean  of 
Z, 


By  Taylor’s  series  expansion. 


(A. 4. 4)  y  =  <}i(zl  =  lv'^1  C”  1 i 

Hence,  the  mean  of  Y  is  given  by,  approximately, 

(A. 4. 5)  £ly]  =  ^  +  I  y' "  j 


Similarly, 
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(A. 
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In  the  above  three  equations. 


4.8)  <plz] 
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and  the  BOBents  of  the  randoB  variate  Z  are  taken  from 


equations  (A. 4. 3). 


1t‘. 

Section  5.  Conclusion 

In  this  appendix,  we  have  presented  two  piobability 
distributions  that  have  proven  useful  in  utility  modellinj. 
Both  Bultivariate  and  univariate  foras  have  been  developed. 
The  convenient  property  of  reproduction  of  distributional 
fora  has  been  deaonstrated  for  marginal  distributions. 
Several  conditional  distributions  have  been  derived. 

It  has  been  shown  that  these  two  distributions,  called 
the  generalized  beta  distribution  and  the  generalized  F 
distribution,  reduce  to  the  standard  beta  and  K 
distributions,  respectively,  in  special  cases.  It  has  also 
been  shown  that  the  two  generalized  distributions  have  a 
relationship  siailar  to  that  between  the  standard  beta  and  F 
distributions.  Finally,  the  aoaents  of  the  generalized  F 
distribution  have  been  presented,  and  approxiaations  for  the 
first  three  central  aoaents  of  the  generalized  beta 
distribution  have  been  derived. 
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5-  Derivatives 


Section  1.  Introduction 

In  this  appendix,  «e  present  the  derivatives  of  the 
three  probability  distributions  used  in  this  paper  to  model 
multiattribute  utility  functions.  Thse  derivatives  are 
necessary  for  the  non-linear  least- squares  algorithm  used  to 
estimate  the  parameters  of  the  model  selected.  The  models 
that  are  available  are  the  cumulative  distribution  functions 
of  the  multivariate  normal,  the  Dirichlet,  and  the  mul¬ 
tivariate  generalized  beta  distributions.  Since  only  the 
univariate  conditional  distributions  are  required  for  the 
estimation  procedure,  the  derivatives  presented  here  are  of 
the  relevant  cumulative  univariate  conditional  distribution 
functions. 

Because  the  derivatives  are  very  complex,  and  because 
ve  are  implementing  three  models  of  utilitie.s  in  thief 
metrics,  the  derivatives  are  presented  in  piece;:.  Tn  '.ec- 
tion  2,  we  present  the  derivatives  of  the  onjective  func¬ 
tion,  that  which  we  strive  to  minimize,  with  respect  to  an 
arbitrary  estimate  of  the  indifference  probability.  As  we 
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are  implementing  three  metrics  in  the  model  estimation 
phase,  the  derivatives  of  these  transformations  are  relevant 
as  well.  Thus,  the  derivatives  of  the  cbgective  function 
are  presented  for  each  of  the  three  metric:  the 
indifference  probability  metric,  the  logodds  metric,  and  the 
arcsine-sguare-root  metric.  The  estimate  of  the 
indifference  probability  is  a  function  of  the  conditional 
utility  function.  The  derivatives  of  the  estimate  of  the 
indifference  probability  with  respect  to  an  arbitrary 
utility  function  is  also  presented  here. 

The  conditional  utility  functions  are  modelled  by  three 
cumulative  probability  distribution  functions:  the  normal, 
the  beta,  and  the  generalized  beta.  In  Sections  3,  h,  and 
5,  the  derivatives  of  the  utility  function  with  respect  to 
its  parameters  are  presented  for  the  three  models,  respec¬ 
tively.  Each  section  is  divided  into  two  parts:  the  first 
part  gives  the  derivatives  of  the  utility  function  with 
respect  to  the  conditional  parameters;  and  the  second  part 
gives  the  derivatives  of  the  conditional  parameters  with 
respect  to  the  unconditional  parameters  (the  parameters  of 
the  multivariate  distribution  that  is  the  model  of  the  mul¬ 
tiattribute  utility  function). 
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Estimation  Metric  Derivatives 


Indifference  Probability  Metric: 
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Indifference  Probability  Estimate: 
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Standard  Beta  Distribution 
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NAVY  PERSONNEL  RAD  CENTER 
SAN  DIEGO,  CA  92152 

1  Library,  Code  P201L 

Navy  Personnel  RAD  Center 
San  Diego,  CA  92152 

6  Commanding  Officer 

Naval  Research  Laboratory 
Code  2627 

Washington,  DC  20390 


lowa/Novick  February  12,  1981 


Page  2 


Navy 


1  Psychologist 

ONR  Branch  Office 
Bldg  114,  Section  D 
666  Summer  Street 
Boston,  MA  02210 

1  Psychologist 

ONR  Branch  Office 
536  S.  Clark  Street 
Chicago,  IL  60605 

1  Office  of  Naval  Research 
Code  437 

800  N.  CJuincy  SStreet 
Arlington,  VA  22217 

5  Personnel  &  Training  Research  Programs 
(Code  458) 

Office  of  Naval  Research 
Arlington,  VA  22217 

1  Psychologist 

ONR  Branch  Office 
1030  East  Green  Street 
Pasadena,  CA  91101 

1  Office  of  the  Chief  of  Naval  Operations 
Research  Development  &  Studies  Branch 
(OP-115) 

Washington,  DC  20350 

1  LT  Frank  C.  Petho,  MSC,  USN  (Ph.D) 

Code  L51 

Naval  Aerospace  Medical  Research  Laborat 
Pensacola,  FL  32508 

1  Dr.  Bernard  Rimland  (03B) 

Navy  Personnel  RAD  Center 
San  Diego,  CA  92152 

1  Dr.  Worth  Scanland 

Chief  of  Naval  Education  and  Training 
code  N-5 

NAS,  Pensacola,  FL  32508 

1  Dr.  Robert  G.  Shilth 

Office  of  Chief  of  Naval  Operations 
OP-987H 

Washington,  DC  20350 


Navy 


1  Dr.  Alfred  F.  Smode 

Training  Analysis  A  Evaluation  Group 
(TAEG) 

Dept,  of  the  Navy 
Orlando,  FL  32813 

1  Dr.  Richard  Sorensen 

Navy  Personnel  RAD  Center 
San  Diego,  CA  92152 

1  Dr.  Ronald  Weitzman 
Code  54  WZ 

Department  of  Administrative  Sciences 
U.  S.  Naval  Postgraduate  School 
Monterey,  CA  93940 

1  Dr.  Robert  Wisher 
Code  309 

Navy  Personnel  RAD  Center 
San  Diego,  CA  92152 

1  DR.  MARTIN  F.  WISKOFF 

NAVY  PERSONNEL  RA  D  CENTER 
SAN  DIEGO,  CA  92152 
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Army 


1  Technical  Director 

U.  S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Myron  Fisc  hi 

U.S.  Army  Research  Institute  for  the 
Social  and  Behavioral  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Dexter  Fletcher 

U.S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria, VA  22333 

1  Dr .  Michael  Kaplan 

U.S,  ARMY  RESEARCH  INSTITUTE 
5001  EISENHOWER  AVENUE 
ALEXANDRIA,  VA  22333 

1  Dr.  Milton  S.  Katz 

Training  Technical  Area 
U.S.  Army  Research  Institute 
5001  Elsenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Harold  F.  O'Neil,  Jr. 

Attn;  PERI-OK 
Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Nr.  Robert  Ross 

U.S.  Army  Research  Institute  for  the 
Social  and  Behavioral  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr .  Robert  Sasmor 

U.  S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences 
5001  Elsenhower  Avenue 
Alexandria,  VA  22333 


Army 


1  Commandant 

US  Army  Institute  of  Administration 
Attn:  Dr.  Sherrill 
FT  Benjamin  Harrison,  IN  46256 

1  Dr.  Frederick  Steinheiser 
U.  S.  Army  Reserch  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Joseph  Ward 

U.S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 
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Air  Force 


Har ines 


1  Air  Force  Human  Resources  Lab 
AFHRL/MPD 

Brooks  AFB,  TX  78235 

1  Dr.  Earl  A.  Alluisi 
HQ,  AFHRL  (AFSC) 

Brooks  AFB,  TX  78235 

1  Research  and  Measurment  Division 
Research  ft-anch,  AFMPC/MPCYPR 
Randolph  AFB,  TX  78148 

1  Dr  .  Mai  colm  Ree 
AFHRL/MP 

Brooks  AFB,  TX  78235 

1  Dr.  Marty  Rockway 
Technical  Director 
AFHRL(OT) 

Williams  AFB,  AZ  58224 


1  H.  William  Greenup 

Education  Advisor  (E031) 

Education  Center ,  MCDEC 
Quantieo,  VA  22134 

1  Director,  Office  of  Manpower  Utilization 
HQ,  Marine  Corps  (MPU) 

BCB,  Bldg.  2009 
Quantieo,  VA  22134 

1  DR.  A.L.  SLAFKOSKY 

SCIENTIFIC  ADVISOR  (CODE  RD-1) 

HQ,  U.S.  MARINE  CORPS 
WASHINGTON,  DC  20380 
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CoastGuard 


Other  DoD 


1  Mr.  Thomas  A.  Warm 

U.  S.  Coast  Guard  Institute 
P.  0.  Substation  18 
Oklahoma  City,  OK  73169 


12  Defense  Technical  Information  Center 
Cameron  Station,  Bldg  5 
Alexandria,  VA  22314 
Attn:  TC 

1  Dr.  William  Graham 
Testing  Directorate 
MEPCOM/MEPCT-P 
Ft.  Sheridan,  IL  60037 

1  Military  Assistant  for  Training  and 
Personnel  Technology 

Office  of  the  Under  Secretary  of  Defense 
for  Research  &  Engineering 
Room  3D129,  The  Pentagon 
Washington,  DC  20301 

1  MAJOR  Wayne  Sellman,  USAF 

Office  of  the  Assistant  Secretary 
of  Defense  (MRA&L) 

3B930  The  Pentagon 
Washington,  DC  20301 

1  DARPA 

1400  Wilson  Blvd. 

Arlington,  VA  22209 
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Civil  Govt 


1  Dr.  Andrew  R.  Molnar 
Science  Education  Dev. 
and  Research 

National  Science  Foundation 
Washington,  DC  20550 

1  Dr.  Vern  W.  Urry 

Personnel  R&D  Center 
Office  of  Personnel  Management 
1900  E  Street  NW 
Washington,  DC  20415 

1  Dr.  Joseph  L.  Young,  Director 
Memory  &  Cognitive  Processes 
National  Science  Foundation 
Washington,  DC  20550 


Non  Govt 


1  Dr.  Erllng  B.  Andersen 
Department  of  Statistics 
Studiestraede  6 
1455  Copenhagen 
DENMARK 

1  1  psychological  research  unit 

Dept,  of  Defense  (Army  Office) 
Campbell  Park  Offices 
Canberra  ACT  2600,  Australia 

1  Dr.  Isaac  Be jar 

Educational  Testing  Service 
Princeton,  NJ  08450 

1  Dr.  Werner  Blrke 

DezWPs  im  Streitkraefteamt 
Postfach  20  50  03 
D-5300  Bonn  2 
WEST  GERMANY 

1  Dr.  Nicholas  A.  Bond 
Dept,  of  Psychology 
Sacramento  State  College 
600  Jay  Street 
Sacramento,  CA  95819 

.  1  Dr.  Robert  Brennan 

American  College  Testing  Programs 

P.  0.  Box  168 

Iowa  City,  lA  52240 

1  DR.  C.  VICTOR  BUNDERSON 
WICAT  INC. 

UNIVERSITY  PLAZA,  SUITE  10 
1160  SO.  STATE  ST. 

OREM,  UT  84057 

1  Dr.  John  B.  Carroll 
Psychometric  Lab 
Univ.  of  No.  Carolina 
Davie  Hall  013A 
Chapel  Hill,  NC  27514 
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Non  Govt 


1  Charles  Myers  Library 
Livingstone  House 
Livingstone  Road 
Stratford 
London  E15  2LJ 
ENGLAND 

1  Dr.  Kenneth  E.  Clark 

College  of  Arts  &  Sciences 
University  of  Rochester 
River  Campus  Station 
Rochester,  NY  14627 

1  Dr.  Norman  Cliff 
Dept,  of  Psychology 
Univ.  of  So.  California 
University  Park 
Los  Angeles,  CA  90007 

1  Dr.  William  E.  Cofftaan 

Director,  Iowa  Testing  Programs 
33*1  Lindquist  Center 
University  of  Iowa 
Iowa  City,  lA  52242 

1  Dr.  Meredith  P.  Crawford 

American  Psychological  Association 
1200  17th  Street,  N.W. 

Washington,  DC  20036 

1  Dr .  Leonard  Feldt 

Lindquist  Center  for  Measurment 
University  of  Iowa 
Iowa  City,  lA  52242 

1  Dr.  Richard  L.  Ferguson 

The  American  College  Testing  Program 

P.O.  Box  168 

Iowa  City,  lA  52240 

1  Dr.  Victor  Fields 
Dept,  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 

1  Univ.  Prof.  Dr.  Gerhard  Fischer 
Liebiggasse  5/3 
A  1010  Vienna 
AUSTRIA 


Non  Govt 


1  Professor  Donald  Fitzgerald 
University  of  New  England 
Armidale,  New  South  Wales  2351 
AUSTRALIA 

1  Dr.  Edwin  A.  Fleishman 

Advanced  Research  Resources  Organ. 
Suite  900 

4330  East  West  Highway 
Washington,  DC  20014 

1  Dr.  John  R.  Frederiksen 
Bolt  Beranek  &  Newman 
50  Moulton  Street 
Cambridge,  MA  02138 

1  DR.  ROBERT  GLASER 
LRDC 

UNIVERSITY  OF  PITTSBURGH 
3939  O'HARA  STREET 
PITTSBURGH,  PA  15213 

1  Dr,  Ron  Hambleton 
School  of  Education 
University  of  Massechusetts 
Amherst,  MA  01002 

1  Dr.  Chester  Harris 
School  of  Education 
University  of  California 
Santa  Barbara,  CA  93106 

1  Dr.  Lloyd  Humphreys 

Department  of  Psychology 
University  of  Illinois 
Champaign,  IL  61820 

1  Library 

HumRRO/We stern  Division 
27857  Berwick  Drive 
Carmel,  CA  93921 

1  Dr.  Steven  Hunka 

Department  of  Education 
University  of  Alberta 
Edmonton,  Alberta 
CANADA 
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Non  Govt 


1  Dr.  Earl  Hunt 

Dept,  of  Psychology 
University  of  Washington 
Seattle,  WA  98105 

1  Dr  .  Huynh  Huynh 

College  of  Education 
University  of  South  Carolina 
Columbia,  SC  29208 

1  Professor  John  A.  Keats 
University  of  Newcastle 
AUSTRALIA  2308 

1  Mr.  Marlin  Kroger 
1117  Via  Goleta 

Palos  Verdes  Estates,  CA  90274 

1  Dr.  Michael  Levine 

Department  of  Educational  Psychology 
210  Education  Bldg. 

University  of  Illinois 
Champaign,  IL  61801 

1  Dr.  Charles  Lewis 

Faculteit  Sociale  Wetenschappen 
Ri jksuniversiteit  Groningen 
Oude  Boter ingestraat 
Groningen 
NETHERLANDS 

1  Dr .  Robert  Linn 

College  of  Education 
University  of  Illinois 
Urbana,  IL  61801 

1  Dr.  Frederick  M.  Lord 

Educational  Testing  Service 
Princeton,  NJ  08540 

1  Dr.  Gary  Marco 

Educational  Testing  Service 
Princeton,  NJ  08450 

1  Dr .  Scott  Maxwell 

Department  of  Psychology 
University  of  Houston 
Houston,  TX  77004 


Non  Govt 


1  Dr.  Samuel  T.  Mayo 

Loyola  University  of  Chicago 
820  North  Michigan  Avenue 
Chicago,  IL  60611 

1  Dr.  Jesse  Orlansky 

Institute  for  Defense  Analyses 
400  Army  Navy  Drive 
Arlington,  VA  22202 

1  Dr.  James  A.  Paulson 

Portland  State  University 
P.O.  Box  751 
Portland,  OR  97207 

1  MR.  LUIGI  PETRULLO 

2431  N.  EDGEWOOD  STREET 
ARLINGTON,  VA  22207 

1  DR.  DIANE  M.  RAMSEY-KLEE 

R^  RESEARCH  &  SYSTEM  DESIGN 
3947  RIDGEMONT  DRIVE 
MALIBU,  CA  90265 

1  MINRAT  M.  L.  RAUCH 
P  II  4 

BUNDESMINISTERIUM  DER  VERTEIDIGUNG 

POSTFACH  1328 

D-53  BONN  1,  GERMANY 

1  Dr.  Mark  D.  Reckase 

Educational  Psychology  Dept. 
University  of  Missour i-Colunbia 
4  Hill  Hall 
Colunbia,  MO  65211 

1  Dr.  Andrew  M.  Rose 

American  Institutes  for  Research 
1055  Thomas  Jefferson  St.  NW 
Washington,  DC  20007 

,  1  Dr.  Leonard  L.  Rosenbaum,  Chairman 
Department  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 


I' 
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Non  Govt 


1  Dr.  Ernst  Z.  Rothkopf 
Bell  Laboratories 
600  Mountain  Avenue 
Murray  Hill,  NJ  07974 

1  Dr .  Lawrence  Rudner 
403  Elm  Avenue 
Takoma  Park,  MD  20012 

1  Dr .  J .  Ryan 

Department  of  Education 
University  of  South  Carolina 
ColLinbia,  SC  29208 

1  PROF.  FUMIKO  SAMEJIMA 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  TENNESSEE 
KNOXVILLE,  TN  37916 

1  DR.  ROBERT  J.  SEIDEL 

INSTRUCTIONAL  TECHNOLOGY  GROUP 
HUMRRO 

300  N.  WASHINGTON  ST. 

ALEXANDRIA,  VA  22314 

1  Dr.  Kazuo  Shigemasu 
University  of  Tohoku 
Department  of  Educational  Psychology 
Kawauchi,  Sendai  980 
JAPAN 

1  Dr .  Edwin  Shirkey 

Department  of  Psychology 
University  of  Central  Florida 
Orlando,  FL  32816 

1  Dr.  Robert  Smith 

Department  of  Computer  Science 

Rutgers  University 

New  Brunswick,  NJ  08903 

1  Dr  .  Richard  Snow 
School  of  Education 
Stanford  University 
Stanford,  CA  94305 


Non  Govt 


1  Dr.  Robert  Sternberg 
Dept,  of  Psychology 
Yale  University 
Box  11A,  Yale  Station 
New  Haven,  CT  06520 

1  DR.  PATRICK  SUPPES 

INSTITUTE  FOR  MATHEMATICAL  STUDIES  IN 
THE  SOCIAL  SCIENCES 
STANFORD  UNIVERSITY 
STANFORD,  CA  94305 

1  Dr.  Hariharan  Swaminathan 

Laboratory  of  Psychometric  and 
Evaluation  Research 
School  of  Education 
University  of  Massachusetts 
Amherst,  MA  01003 

1  Dr.  Brad  Sympson 

Psychometric  Research  Group 
Educational  Testing  Service 
Princeton,  NJ  08541 

1  Dr.  Kikumi  Tatsuoka 

Computer  Based  Education  Research 
Laboratory 

252  Engineering  Research  Laboratory 
University  of  Illinois 
Urbana,  IL  61801 

1  Dr.  David  Thissen 

Department  of  Psychology 
University  of  Kansas 
Lawrence,  KS  66044 

1  Dr.  Robert  Tsutakawa 

Department  of  Statistics 
University  of  Missouri 
Columbia,  MO  65201 

1  Dr.  J.  Uhlaner 

Perceptronics,  Inc. 

6271  Variel  Avenue 
Woodland  Hills,  CA  91364 
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Non  Govt 


1  Dr.  Howard  Walner 

Bureau  of  Social  science  Research 
1990  M  Street,  N.  W. 

Washington,  DC  20036 

1  Dr.  Phyllis  Weaver 

Graduate  School  of  Education 
Harvard  University 
200  Larsen  Hall,  Applan  Way 
Cambridge,  MA  02138 

1  DR.  SUSAN  E.  WHITELY 
PSYCHOLOGY  DEPARTMENT 
UNIVERSITY  OF  KANSAS 
UWRENCE,  KANSAS  6601(4 

1  Wolfgang  Wlldgrube 
Streitkraefteamt 
Box  20  50  03 
D-5300  Bonn  2 


